Mobile terminal and method of operating the same

ABSTRACT

A mobile terminal and a method of operating the mobile terminal are provided. The mobile terminal includes a sensor configured to sense a motion of the mobile terminal, and a communication interface configured to receive, from a wearable device corresponding to the mobile terminal, information of a motion of the wearable device, the motion of the wearable device being sensed during a time period from a start time requested by the mobile terminal. The mobile terminal further includes a controller configured to determine whether the motion of the mobile terminal and the motion of the wearable device have a correlation of a level or greater, and unlock the mobile terminal, in response to the controller determining that the motion of the mobile terminal and the motion of the wearable device have the correlation of the level or greater.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority from Korean Patent Application Nos.10-2014-0098643, filed on Jul. 31, 2014, 10-2014-0156242, filed on Nov.11, 2014, and 10-2015-0078247 filed on Jun. 2, 2015, in the KoreanIntellectual Property Office, the disclosures of which are incorporatedherein by reference in their entireties.

BACKGROUND

1. Field

Apparatuses and methods consistent with exemplary embodiments relate toa mobile terminal and a method of operating the mobile terminal.

2. Description of the Related Art

A mobile terminal is a portable device having one or more functionsamong a function of performing voice and video calls while beingcarried, a function of inputting or outputting information, and afunction of storing data. Such a mobile terminal may also havecomplicated functions such as taking a picture or a video, reproducing amusic file or a video file, playing a game, receiving a broadcast, andcommunicating via wireless Internet, and thus may be a multimediaplayer.

Also, various kinds of wearable devices that a user may wear have beendeveloped, and thus a technology that allows the user to use the mobileterminal more conveniently may be needed.

SUMMARY

Exemplary embodiments address at least the above problems and/ordisadvantages and other disadvantages not described above. Also, theexemplary embodiments are not required to overcome the disadvantagesdescribed above, and may not overcome any of the problems describedabove.

Exemplary embodiments provide a mobile terminal, a lock mode of which isreleased by a user when a motion of the mobile terminal is equal to amotion of a wearable device, and a method of operating the mobileterminal.

According to an aspect of an exemplary embodiment, there is provided amobile terminal including a sensor configured to sense a motion of themobile terminal, and a communication interface configured to receive,from a wearable device corresponding to the mobile terminal, informationof a motion of the wearable device, the motion of the wearable devicebeing sensed during a time period from a start time requested by themobile terminal. The mobile terminal further includes a controllerconfigured to determine whether the motion of the mobile terminal andthe motion of the wearable device have a correlation of a level orgreater, and unlock the mobile terminal, in response to the controllerdetermining that the motion of the mobile terminal and the motion of thewearable device have the correlation of the level or greater.

The sensor may be further configured to sense the motion of the mobileterminal during a time period identical to the time period during whichthe motion of the wearable device is sensed.

The wearable device may be unlocked.

The controller may be further configured to determine whether the motionof the mobile terminal and a motion set in advance have a correlation ofa level or greater, and the communication interface may be furtherconfigured to receive, from the wearable device, the information of themotion of the wearable device, in response to the controller determiningthat the motion of the mobile terminal and the motion set in advancehave the correlation of the level or greater.

The mobile terminal may further include a display, the controller may befurther configured to recognize that the wearable device is within adistance range from the mobile terminal, and the display may beconfigured to display a message notifying that the mobile terminal maybe unlocked if the motion of the mobile terminal and the motion of thewearable device are the same or similar, in response to the controllerrecognizing that the wearable device is within the distance range.

The controller may be further configured to control the mobile terminalto perform an operation corresponding to an operation that the wearabledevice is performing, in response to the controller determining that themotion of the mobile terminal and the motion of the wearable device havethe correlation of the level or greater.

The communication interface may be further configured to receive, fromthe wearable device, information of content that the wearable device isreproducing, in response to the controller determining that the motionof the mobile terminal and the motion of the wearable device have thecorrelation of the level or greater, and the controller may be furtherconfigured to control the mobile terminal to reproduce the content basedon the information of the content.

The communication interface may be further configured to receive, fromthe wearable device, information of a web page that the wearable deviceis displaying, in response to the controller determining that the motionof the mobile terminal and the motion of the wearable device have thecorrelation of the level or greater, and the mobile terminal may furtherinclude a display configured to display the web page based on theinformation of the web page.

The communication interface may be further configured to receive, fromthe wearable device, information of a call the wearable device isconnecting, in response to the controller determining that the motion ofthe mobile terminal and the motion of the wearable device have thecorrelation of the level or greater, and the controller may be furtherconfigured to control the mobile terminal to connect the call based onthe information of the call.

The communication interface may be further configured to receive, fromthe wearable device, information of an application corresponding to amessage the wearable device receives, in response to the controllerdetermining that the motion of the mobile terminal and the motion of thewearable device have the correlation of the level or greater, and thecontroller may be further configured to control the mobile terminal toexecute the application based on the information of the application.

According to an aspect of another exemplary embodiment, there isprovided a method of operating a mobile terminal, the method includingsensing a motion of the mobile terminal, and receiving, from a wearabledevice corresponding to the mobile terminal, information of a motion ofthe wearable device, the motion of the wearable device being sensedduring a time period from a start time requested by the mobile terminal.The method further includes determining whether the motion of the mobileterminal and the motion of the wearable device have a correlation of alevel or greater, and unlocking the mobile terminal, in response to thedetermining that the motion of the mobile terminal and the motion of thewearable device have the correlation of the level or greater.

The sensing may include sensing the motion of the mobile terminal duringa time period identical to the time period during which the motion ofthe wearable device is sensed.

The method may further include determining whether the motion of themobile terminal and a motion set in advance have a correlation of alevel or greater, and the receiving may include receiving, from thewearable device, the information of the motion of the wearable device,in response to the determining that the motion of the mobile terminaland the motion set in advance have the correlation of the level orgreater.

The method may further include recognizing that the wearable device iswithin a distance range from the mobile terminal, and displaying amessage notifying that the mobile terminal may be unlocked if the motionof the mobile terminal and the motion of the wearable device are thesame or similar, in response to the recognizing that the wearable deviceis within the distance range.

The method may further include performing an operation corresponding toan operation that the wearable device is performing, in response to thedetermining that the motion of the mobile terminal and the motion of thewearable device have the correlation of the level or greater.

The method may further include receiving, from the wearable device,information of content that the wearable device is reproducing, inresponse to the determining that the motion of the mobile terminal andthe motion of the wearable device have the correlation of the level orgreater, and reproducing the content based on the information of thecontent.

The method may further include receiving, from the wearable device,information of a web page that the wearable device is displaying, inresponse to the determining that the motion of the mobile terminal andthe motion of the wearable device have the correlation of the level orgreater, and displaying the web page based on the information of the webpage.

The method may further include receiving, from the wearable device,information of a call the wearable device is connecting, in response tothe determining that the motion of the mobile terminal and the motion ofthe wearable device have the correlation of the level or greater, andconnecting the call based on the information of the call.

The method may further include receiving, from the wearable device,information of an application corresponding to a message the wearabledevice receives, in response to the determining that the motion of themobile terminal and the motion of the wearable device have thecorrelation of the level or greater, and executing the application basedon the information of the application.

According to an aspect of another exemplary embodiment, there isprovided a mobile terminal including a sensor configured to sense aninput for unlocking the mobile terminal, and a motion of the mobileterminal, and a communication interface configured to request a wearabledevice corresponding to the mobile terminal for a motion of the wearabledevice, in response to the sensor sensing the input, and receive, fromthe wearable device, information of the motion of the wearable device,the motion of the wearable device being sensed during a time period froma start time requested by the mobile terminal, and a controllerconfigured to determine whether the motion of the mobile terminal andthe motion of the wearable device have a correlation of a level orgreater, and unlock the mobile terminal, in response to the controllerdetermining that the motion of the mobile terminal and the motion of thewearable device have the correlation of the level or greater.

The input may include a hold and a lift of the mobile terminal.

According to an aspect of another exemplary embodiment, there isprovided a mobile terminal including a controller configured todetermine whether a first data of the mobile terminal and a second dataof a wearable device connected to the mobile terminal have a correlationgreater than or equal to a level, the first data and the second databeing of a same type of data, and the first data and the second databeing obtained during a same time period. The controller is furtherconfigured to perform an operation corresponding to an operation thatthe wearable device is performing, in response to the controllerdetermining that the first data and the second data have the correlationgreater than or equal to the level.

The mobile terminal may further include a sensor configured to sense abio signal of a user of the mobile terminal as the first data, and acommunication interface configured to receive, from the wearable device,information of a bio signal of a user of the wearable device as thesecond data.

The mobile terminal may further include a sensor configured to sense atouch pattern on the mobile terminal as the first data, and acommunication interface configured to receive, from the wearable device,information of a touch pattern on the mobile terminal that the wearabledevice photographs as the second data.

The mobile terminal may further include a camera configured tophotograph an image of a user of the mobile terminal as the first data,and a communication interface configured to receive, from the wearabledevice, an image of a user of the wearable device as the second data.

The performed operation may include at least one among an unlock of themobile terminal, an authentication of a user of the mobile terminal, adisplay of a web page, a connection of a call, an execution of anapplication, a display of a message, a reproduction of content, and aswitch from a common mode to a personal mode of the mobile terminal.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or other aspects will be more apparent by describingcertain exemplary embodiments with reference to the accompanyingdrawings in which:

FIG. 1 is a diagram showing an interaction between a mobile terminal anda wearable device, according to an exemplary embodiment;

FIG. 2 is a diagram illustrating an operation of releasing a lock modeof a mobile terminal, when a motion of the mobile terminal is equal to amotion of a wearable device, according to an exemplary embodiment;

FIG. 3A is a flowchart of a method of operating a mobile terminal,according to an exemplary embodiment;

FIG. 3B is a diagram illustrating a method of determining whether amotion of a wearable device is equal to a motion of a mobile terminal inthe mobile terminal, according to an exemplary embodiment;

FIG. 4 is a flowchart of an interaction between a mobile terminal and awearable device, according to an exemplary embodiment;

FIG. 5 is a flowchart illustrating an interaction between a mobileterminal and a wearable device to perform an unlocking operation of themobile terminal, according to an exemplary embodiment;

FIG. 6 is a diagram showing an example in which a wearable device entersa lock mode or an unlock mode depending on whether a user wears thewearable device or not, according to an exemplary embodiment;

FIG. 7 is a diagram showing an example of displaying a motion unlockfunction notification message on a mobile terminal, according to anexemplary embodiment;

FIGS. 8A, 8B, 9A, and 9B are diagrams showing operations of unlocking alock mode of a mobile terminal, if a user of the mobile terminal and awearer of a wearable device are the same person, according to anexemplary embodiment;

FIG. 10 is a flowchart illustrating a method of performing a userauthentication in a mobile terminal, in a case where a wearable deviceperform the user authentication, according to an exemplary embodiment;

FIG. 11 is a diagram illustrating the method of FIG. 10;

FIG. 12 is a flowchart illustrating a method of displaying a web pagedisplayed on a wearable device, on a mobile terminal, according to anexemplary embodiment;

FIG. 13 is a diagram illustrating the method of FIG. 12;

FIG. 14 is a flowchart illustrating a method of making a phone call byusing a mobile terminal if a wearable device receives a call connectionrequest, according to an exemplary embodiment;

FIG. 15 is a diagram illustrating the method of FIG. 14;

FIG. 16 is a flowchart illustrating a method of performing a phone callwith an external device by using a mobile terminal, while the phone callis made with the external device by using a wearable device, accordingto an exemplary embodiment;

FIG. 17 is a diagram illustrating the method of FIG. 16;

FIG. 18 is a flowchart illustrating a method of executing an applicationrelated to a notification message in a mobile terminal, when a wearabledevice receives the notification message, according to an exemplaryembodiment;

FIGS. 19 and 20 are diagrams illustrating the method of FIG. 18;

FIG. 21 is a flowchart illustrating a method of displaying a message ona mobile terminal, when a wearable device receives the message,according to an exemplary embodiment;

FIG. 22 is a diagram illustrating the method of FIG. 21;

FIG. 23 is a flowchart illustrating a method of reproducing content in amobile terminal, when the content is being reproduced by a wearabledevice, according to an exemplary embodiment;

FIG. 24 is a diagram illustrating the method of FIG. 23;

FIG. 25 is a diagram of a method of displaying content that is currentlybeing displayed on a wearable device, on a mobile terminal, according toan exemplary embodiment;

FIG. 26 is a diagram illustrating a method of transmitting data on awearable device to a mobile terminal, according to an exemplaryembodiment;

FIG. 27 is a flowchart illustrating a method of executing an operationset in advance in a mobile terminal, if a bio signal sensed by themobile terminal is equal to a bio signal sensed by a wearable device,according to an exemplary embodiment;

FIG. 28 is a diagram referred to describe the exemplary embodiment ofFIG. 27;

FIG. 29 is a flowchart illustrating a method of performing an operationset in advance in a mobile terminal, when a touch pattern sensed by themobile terminal is the same as a pattern captured by a wearable device,according to an exemplary embodiment;

FIG. 30 is a diagram illustrating the method of FIG. 29;

FIG. 31 is a flowchart illustrating a method of performing an operationset in advance in a mobile terminal, when a user video captured by themobile terminal is the same as a user video captured by a wearabledevice, according to an exemplary embodiment;

FIG. 32 is a diagram illustrating the method of FIG. 31;

FIG. 33 is a flowchart of a method of operating a mobile terminal,according to an exemplary embodiment;

FIGS. 34 to 37 are flowcharts illustrating a method of switching acommon mode to a personal mode, based on whether a user of the mobileterminal wears a wearable device connected to the mobile terminal,according to exemplary embodiments;

FIG. 38 is a diagram of a common mode and a personal mode of a mobileterminal, according to an exemplary embodiment;

FIG. 39 is a diagram of a method of operating a mobile terminal in acommon mode, according to an exemplary embodiment;

FIG. 40 is a diagram of a method of operating a mobile terminal in apersonal mode, according to an exemplary embodiment;

FIG. 41 is a diagram of a common mode and a personal mode of a mobileterminal, according to an exemplary embodiment;

FIGS. 42 and 43 are block diagrams of a mobile terminal, according toexemplary embodiments;

FIG. 44 is a block diagram of a wearable device, according to anexemplary embodiment;

FIG. 45 is a diagram of an interaction between a smart door-lock and awearable device, according to an exemplary embodiment; and

FIG. 46 is a diagram of a method of displaying detailed information of anotification message on a mobile terminal, when a motion of the mobileterminal is the same as a motion of a wearable device, according to anexemplary embodiment.

DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS

Exemplary embodiments are described in greater detail herein withreference to the accompanying drawings.

In the following description, like drawing reference numerals are usedfor like elements, even in different drawings. The matters defined inthe description, such as detailed construction and elements, areprovided to assist in a comprehensive understanding of the exemplaryembodiments. However, it is apparent that the exemplary embodiments canbe practiced without those specifically defined matters. Also,well-known functions or constructions are not described in detailbecause they would obscure the description with unnecessary detail.

It will be understood that the terms “comprises” and/or “comprising”used herein specify the presence of stated features or components, butdo not preclude the presence or addition of one or more other featuresor components. In addition, the terms such as “unit,” “-er (-or),” and“module” described in the specification refer to an element forperforming at least one function or operation, and may be implemented inhardware, software, or the combination of hardware and software.

As used herein, the term “and/or” includes any and all combinations ofone or more of associated listed items. Expressions such as “at leastone of,” when preceding a list of elements, modify the entire list ofelements and do not modify the individual elements of the list.

FIG. 1 is a diagram showing an interaction between a mobile terminal 100and a wearable device 200, according to an exemplary embodiment.

The mobile terminal 100 according to an exemplary embodiment may beformed in various types. For example, the mobile terminal 100 may be amobile phone, a smart phone, a laptop computer, a tablet PC, anelectronic book terminal, a digital broadcasting terminal, a personaldigital assistant (PDA), a portable multimedia player (PMP), anavigation system, an MP3 player, a digital camera, an internet protocoltelevision (IPTV), a digital TV, or a CE appliance (for example, arefrigerator or an air conditioner having a display device), but is notlimited thereto.

Also, the wearable device 200 according to an exemplary embodiment mayinclude a watch, a band, or a bracelet that a user may wear on thewrist, but is not limited thereto, that is, the wearable device 200 mayinclude glasses, a helmet, a hat, a ring, shoes, earrings, a hair band,clothes, gloves, or a thimble.

The mobile terminal 100 and the wearable device 200 according to theexemplary embodiment may communicate with each other. For example, themobile terminal 100 may transmit or receive data to/from the wearabledevice 200 via short-range communication. Here, the short rangecommunication may be performed in wireless fidelity (Wi-Fi), near fieldcommunication (NFC), Bluetooth, an infrared ray method, and ZigBee, butis not limited thereto.

Also, the wearable device 200 according to the exemplary embodiment maytransmit user authentication information or device identificationinformation of the wearable device 200 to the mobile terminal 100, andthe mobile terminal 100 may transmit user authentication information orterminal identification information of the mobile terminal 100 to thewearable device 200.

Here, the user authentication information may include a user ID, userpassword, and user account. Also, the device identification informationor the terminal identification information is exclusive information fordistinguishing the device or the terminal from other devices, and mayinclude, for example, the model name and serial number of the device.

Also, the mobile terminal 100 stores the user authentication informationor the device identification information of the wearable device 200, andmay register the wearable device 200 in the mobile terminal 100.

Also, the wearable device 200 according to the exemplary embodiment mayregularly transmit the device identification information one way, andmay broadcast the device identification information to outside thewearable device 200 via Bluetooth low energy (BLE) communication.

In addition, the mobile terminal 100 may recognize the existence of thewearable device 200 that is around the mobile terminal 100, based on thedevice identification information that the mobile terminal 100 hasreceived. Also, the wearable device 200 may recognize the existence ofthe mobile terminal 100 that is around the wearable device 200, based onthe terminal identification information that the wearable device 200 hasreceived.

Also, the mobile terminal 100 may determine whether the recognizedwearable device 200 is connected to the mobile terminal 100, bycomparing the user authentication information or the deviceidentification information of the recognized wearable device 200 withthe user authentication information or the device identificationinformation of the registered wearable device.

In addition, the mobile terminal 100 may acquire motion information ofthe mobile terminal 100 by sensing movement of the mobile terminal 100.

Here, the motion information of the mobile terminal 100 may includevalues obtained by sensing movement of the mobile terminal 100 by usinga geomagnetic sensor, a location sensor, an acceleration sensor, aproximity sensor, or a gyroscope sensor, for example, a directionalityvalue, a velocity value, or an acceleration value of the mobile terminal100, but is not limited thereto.

Also, the wearable device 200 according to the exemplary embodiment maysense movement of the wearable device 200. For example, the wearabledevice 200 may sense the movement of the wearable device 200 by using ageomagnetic sensor, a location sensor, an acceleration sensor, aproximity sensor, or a gyroscope sensor, and may acquire motioninformation of the wearable device 200, wherein the motion informationmay include a directionality value, a velocity value, or an accelerationvalue of the wearable device 200.

Also, the mobile terminal 100 according to the exemplary embodiment maysense a touch input to the mobile terminal 100. Also, the mobileterminal 100 may sense a bio signal of a user of the mobile terminal100. Also, the mobile terminal 100 may sense various signals transmittedfrom external devices that are around the mobile terminal 100 (forexample, the wearable device 200). This will be described in more detaillater.

Also, the wearable device 200 according to the exemplary embodiment mayinclude a camera to capture images. Also, the wearable device 200 maysense a bio signal of a wearer of the wearable device 200. Also, thewearable device 200 may sense various signals transmitted from externaldevices that are around the wearable device 200 (for example, the mobileterminal 100). This will be described in more detail later.

In addition, the wearable device 200 according to the exemplaryembodiment may transmit information sensed by the wearable device 200 tothe mobile terminal 100 connected to the wearable device 200.

For example, the motion information of the wearable device 200 that thewearable device 200 sensed itself may be transmitted to the mobileterminal 100 connected to the wearable device 200.

Otherwise, the wearable device 200 may transmit the bio signalinformation of the wearer of the wearable device 200, image informationcaptured by the wearable device 200, and signal information of theexternal devices sensed by the wearable device 200 to the mobileterminal 100 that is connected to the wearable device 200.

Accordingly, the mobile terminal 100 according to the exemplaryembodiment may compare the information that the mobile terminal 100itself sensed with the information sensed by the wearable device 200,and may execute an operation set in advance if the information sensed bythe mobile terminal 100 is the same as the information sensed by thewearable device 200.

Also, if the information sensed by the mobile terminal 100 is the sameas the information sensed by the wearable device 200, the mobileterminal 100 may determine that the user of the mobile terminal 100 iswearing the wearable device 200.

Also, the operation set in advance may be an operation related to anoperation that is currently being performed by the wearable device 200.For example, if the wearable device 200 is in an unlock mode, a lockmode of the mobile terminal 100 may be unlocked. If the wearable device200 displays a web page, the mobile terminal 100 may display the webpage that is currently being displayed on the wearable device 200.Otherwise, if the wearable device 200 reproduces a piece of content, themobile terminal 100 may reproduce the piece of content successively.Otherwise, if the wearable device 200 receives a request for making aphone call, the mobile terminal 100 may make the phone call. If thewearable device 200 receives an alarm message, the mobile terminal 100may execute an application related to the alarm message. However, one ormore exemplary embodiments are not limited to the above examples, andother various operations may be performed.

FIG. 2 is a diagram showing an operation of unlocking a lock mode of themobile terminal 100, when a motion of the mobile terminal 100 is equalto a motion of the wearable device 200, according to an exemplaryembodiment.

FIG. 2 shows a state where a user of the mobile terminal 100 holds themobile terminal 100 with a hand while wearing the wearable device 200 ona wrist. In FIG. 2, the wearable device 200 is a wrist watch, but is notlimited thereto.

As shown in FIG. 2, when the user of the mobile terminal 100 moves thehand holding the mobile terminal 100 while wearing the wearable device200 on the wrist (the wrist of the hand holding the mobile terminal100), a movement of the mobile terminal 100 coincides with a movement ofthe wearable device 200. That the movement of the mobile terminal 100coincides with the movement of the wearable device 200 denotes thatmotion information of the mobile terminal 100 and the wearable device200 (for example, directions, sizes, velocities, and patterns of themovements of the mobile terminal 100 and the wearable device 200) is thesame, or that a difference between the motion information of the mobileterminal 100 and the motion information of the wearable device 200 iswithin a predetermined range.

For example, a motion pattern of the mobile terminal 100 may be equal toa motion pattern of the wearable device 200. As shown in FIG. 2, whenthe user picks up the mobile terminal 100 with the hand wearing thewearable device 200, the motion pattern of the mobile terminal 100 (afirst motion pattern m1) may indicate a rotation by a predeterminedangle in a counter-clockwise direction. Also, a motion pattern (a secondmotion pattern m2) of the wearable device 200, which is sensed by thewearable device 200, may also indicate the rotation by the predeterminedangle in the counter-clockwise direction.

When the motion information of the mobile terminal 100 is the same asthe motion information of the wearable device 200, and the wearabledevice 200 is in an unlock state through a predetermined authenticationprocess, the mobile terminal 100 unlocks the lock mode thereof.

For example, when the wearable device 200 is in the unlock state, thewearable device 200 may transmit a signal indicating the unlock state tothe mobile terminal 100. Also, the wearable device 200 may transmit themotion information thereof to the mobile terminal 100.

However, one or more exemplary embodiments are not limited thereto, thatis, the mobile terminal 100 may unlock the lock mode thereof when themotion information of the mobile terminal 100 is the same as the motioninformation of the wearable device 200 without regard to the unlockstate of the wearable device 200.

In FIG. 2, a display of the wearable device 200 is activated to indicatean unlocking of the lock mode of the wearable device 200. However, oneor more exemplary embodiments are not limited thereto, and the displayof the wearable device 200 may be inactivated (the display is turnedoff). In FIG. 2, displays of the wearable device 200 and the mobileterminal 100 are located at the same side based on the hand of the user,but the displays of the mobile terminal 100 and the wearable device 200may be located opposite to each other based on the hand of the user.

Accordingly, when the first motion pattern m1 sensed by the mobileterminal 100 and the second motion pattern m2 sensed by the wearabledevice 200 show the same pattern as each other, the mobile terminal 100determines that the first motion pattern is the same as the secondmotion pattern. In addition, the mobile terminal 100 may determine thatthe user of the mobile terminal 100 and the wearer of the wearabledevice 200 are the same person. Accordingly, the mobile terminal 100determines whether the user of the mobile terminal 100 wears thewearable device 200 by comparing the first motion pattern of the mobileterminal 100 with the second motion pattern of the wearable device 200.

Also, the mobile terminal 100 may unlock the lock mode of the mobileterminal 100 when the motion information of the mobile terminal 100 isthe same as the motion information of the wearable device 200, and thelock mode of the wearable device 200 is unlocked through predeterminedauthentication processes.

For example, as shown in FIG. 2, the mobile terminal 100 displays a homescreen on the display of the mobile terminal 100, which had been in theinactivated state. That is, the user may unlock the mobile terminal 100only with a motion without directly inputting a password to the mobileterminal 100 to unlock the lock mode of the mobile terminal 100.

FIG. 3A is a flowchart of a method of operating the mobile terminal 100,according to an exemplary embodiment, and FIG. 3B is a diagramillustrating a method of determining whether a motion of the wearabledevice 200 is the same as a motion of the mobile terminal 100 in themobile terminal 100, according to the exemplary embodiment.

In operation S310, the mobile terminal 100 acquires motion informationof the mobile terminal 100 by sensing the motion of the mobile terminal100. For example, the mobile terminal 100 may measure a movingdirection, a velocity, and variation in the velocity of the mobileterminal 100 by using a geomagnetic sensor, a location sensor, anacceleration sensor, a proximity sensor, or a gyroscope sensor to sensethe motion of the mobile terminal 100.

In operation S320, the mobile terminal 100 receives motion informationof the wearable device 200, which is sensed by the wearable device 200,from the wearable device 200 connected to the mobile terminal 100. Forexample, the wearable device 200 connected to the mobile terminal 100may measure a moving direction, a velocity, and variation in thevelocity of the wearable device 200 by using a geomagnetic sensor, alocation sensor, an acceleration sensor, a proximity sensor, or agyroscope sensor to sense the motion of the wearable device 200. Themobile terminal 100 may receive time information about the motioninformation of the wearable device 200. Also, the mobile terminal 100may request the wearable device 200 for the motion information of thewearable device 200, and the wearable device 200 may transmit the motioninformation thereof, which is sensed by the wearable device 200, to themobile terminal 100.

In operation S330, the mobile terminal 100 determines whether the motionof the mobile terminal 100 and the motion of the wearable device 200 arethe same or similar. Here, that the motion of the mobile terminal 100 isthe same as the motion of the wearable device 200 does not denote thatthe motions are physically equal to each other, but may denote that themotion information of the mobile terminal 100 (for example, a direction,a size, and a velocity of a movement the mobile terminal 100) coincideswith the motion information of the wearable device 200 (for example, adirection, a size, and a velocity of a movement of the wearable device200) within a predetermined range. Also, that the motion of the mobileterminal 100 is the same as the motion of the wearable device 200 maydenote that the motion information of the mobile terminal 100 and themotion information of the wearable device 200 have a correlation of apredetermined level or greater.

The mobile terminal 100 may compare the motion information of the mobileterminal 100, which is sensed at the same time as the motion informationof the wearable device 200, with the motion information of the wearabledevice 200, based on the time information with respect to the motioninformation of the wearable device 200. Hereinafter, this will bedescribed below with reference to FIG. 3B.

Referring to FIG. 3B, an acceleration value according to time sensed bythe wearable device 200 is shown as a first graph 310, and the firstgraph 310 is generated based on a coordinate system 315 of the wearabledevice 200. Also, an acceleration value according to time sensed by themobile terminal 100 is shown as a second graph 320, and the second graph320 is generated based on a coordinate system 325 of the mobile terminal100.

In addition, because the coordinate system 315 of the wearable device200 is different from the coordinate system 325 of the mobile terminal100, a process of converting the acceleration values of the wearabledevice 200 and the mobile terminal 100 into values on the samecoordinate system is needed. For example, the wearable device 200 mayconvert the acceleration value on the coordinate system 315 of thewearable device 200 into an acceleration value on a reference coordinatesystem 335 by using a geomagnetic sensor, and then, may generate a thirdgraph 340 based on the converted acceleration value. Otherwise, themobile terminal 100 may receive the acceleration value sensed by theacceleration sensor of the wearable device 200 and geomagnetic valuessensed by the geomagnetic sensor, and then, may convert the first graph310 into the third graph 340. Also, the mobile terminal 100 may convertthe acceleration value on the coordinate system 325 of the mobileterminal 100 into an acceleration value on the reference coordinatesystem 335 by using a geomagnetic sensor, and may generate a fourthgraph 350 based on the converted acceleration value.

Here, the reference coordinate system 335 is a coordinate system thatmay be applied independently from a kind of a device. For example, thereference coordinate system 335 may include three axes (X-axis, Y-axis,and Z-axis). Based on a user, the X-axis denotes a reference axiscrossing the user in a back and forth direction, the Y-axis denotes areference axis crossing the user in left and right directions, and theZ-axis denotes a reference axis crossing the user in up and downdirections. The X-axis, the Y-axis, and the Z-axis may be perpendicularto each other, but are not limited thereto.

The mobile terminal 100 compares the third graph 340 with the fourthgraph 350 on the same reference coordinate system 335 to compare theacceleration values with respect to a predetermined time period 360 onthe third and fourth graphs 340 and 350, thereby determining whether themotion of the mobile terminal 100 is the same as the motion of thewearable device 200. For example, if a difference between theacceleration value of the wearable device 200 and the acceleration valueof the mobile terminal 100 within the predetermined time period 360 isequal to or less than a predetermined value, the mobile terminal 100 maydetermine that the motion information of the mobile terminal 100 (forexample, the acceleration value of the mobile terminal 100) and themotion information of the wearable device 200 (for example, theacceleration value of the wearable device 200) have a correlation of apredetermined level or greater. That is, the mobile terminal 100 maydetermine that the motion of the mobile terminal 100 is the same as themotion of the wearable device 200.

Also, the mobile terminal 100 may determine whether the motion of themobile terminal 100 is the same as that of the wearable device 200 bymagnifying or reducing the motion information transmitted from thewearable device 200 by a preset ratio according to a kind of thewearable device 200 (that is, the motion information of the wearabledevice 200 varies depending on the kind of the wearable device 200because a wearing state and a wearing position vary depending on thekind of the wearable device 200), and by comparing the expanded orreduced motion information of the wearable device 200 with the motioninformation of the mobile terminal 100. For example, if the wearabledevice 200 is a smart watch, a location of holding the mobile terminal100 with a hand and a location of wearing the smart watch may be apartabout 5 cm from each other, and the motion information may be expandedby the preset ratio while taking the distance (5 cm) into account.

Referring again to FIG. 3A, in operation S340, when the motion of themobile terminal 100 and the motion of the wearable device 200 aredetermined to be the same or similar, the mobile terminal 100 unlocks alock mode thereof. An unlock state of the mobile terminal 100 may be astate in which a home screen is displayed on a display of the mobileterminal 100. Otherwise, the unlock state of the mobile terminal 100 maybe a state in which a menu of applications installed on the mobileterminal 100 is displayed on the display of the mobile terminal 100 anda menu of an application is selected to execute the selectedapplication, but is not limited thereto.

FIG. 4 is a flowchart of an interaction between the mobile terminal 100and the wearable device 200, according to an exemplary embodiment.

Referring to FIG. 4, in operation S410, the wearable device 200 is in astate in which a lock mode is unlocked. For example, an unlock state ofthe wearable device 200 may be a state in which a home screen isdisplayed on a display of the wearable device 200. Otherwise, menus ofapplications installed on the wearable device 200 are displayed on thedisplay of the wearable device 200, and thus, if a menu of anapplication is selected, the selected application may be executed.

A lock mode state of the wearable device 200 may be a state in which thedisplay of the wearable device 200 is inactivated. Otherwise, if thewearable device 200 is a watch, the lock mode state may be a state inwhich time information is only displayed on the display of the wearabledevice 200. Otherwise, the lock mode state may be a state in which menusof some of the applications installed on the wearable device 200 aredisplayed on the display of the wearable device 200 so that otherapplications that are not displayed on the display of the wearabledevice 200 may not be executed.

In operation S420, the wearable device 200 transmits identificationinformation to the mobile terminal 100 that is in a predetermineddistance range. For example, if the mobile terminal 100 and the wearabledevice 200 are located apart from each other within the predetermineddistance range, the mobile terminal 100 and the wearable device 200 maytransmit/receive user identification information and deviceidentification information to/from each other via short-rangecommunication.

In operation S430, the mobile terminal 100 recognizes the wearabledevice 200 that is within the predetermined distance range from themobile terminal 100.

In operation S440, the mobile terminal 100 determines whether therecognized wearable device 200 is a wearable device connected to themobile terminal 100. For example, the mobile terminal 100 may comparethe identification information transmitted from the wearable device 200with the identification information of the wearable device 200 that isregistered in the mobile terminal 100 to determine whether therecognized wearable device 200 is a wearable device connected to themobile terminal 100.

When the recognized wearable device 200 is determined to be a wearabledevice connected to the mobile terminal 100, in operation S450, themobile terminal 100 senses a motion of the mobile terminal 100 toacquire motion information of the mobile terminal 100. For example, themobile terminal 100 may sense a direction, a velocity, and a variationin the velocity of a movement of the mobile terminal 100 by using ageomagnetic sensor, a location sensor, an acceleration sensor, aproximity sensor, or a gyroscope sensor. Because operation S450 of FIG.4 corresponds to operation S310 shown in FIG. 3, detailed descriptionsthereof are omitted.

In operation S455, the wearable device 200 senses a motion of thewearable device 200 to acquire motion information of the wearable device200. Here, the wearable device 200 may sense the motion of the wearabledevice 200 at the same time the mobile terminal 100 senses the motion ofthe mobile terminal 100 in operation S450. For example, the wearabledevice 200 may measure a direction, a velocity, and a variation in thevelocity of a movement of the wearable device 200 by using a geomagneticsensor, a location sensor, an acceleration sensor, a proximity sensor,or a gyroscope sensor.

In operation S460, the mobile terminal 100 requests the wearable device200 for the motion information of the wearable device 200. The mobileterminal 100 may request the wearable device 200 for the motioninformation of the wearable device 200 after setting a time range. Themobile terminal 100 may set a start time and a finish time of the motioninformation to be requested, and then, may request the wearable device200 for the motion information of the wearable device 200. For example,if the mobile terminal 100 is to compare the motion information sensedby the mobile terminal 100 from a first time to a second time with themotion information of the wearable device 200, the mobile terminal 100may request the wearable device 200 for the motion information sensed bythe wearable device 200 from the first time to the second time.

In operation S470, the wearable device 200 transmits the motioninformation of the wearable device 200 to the mobile terminal 100. Also,the mobile terminal 100 and the wearable device 200 may set the timerange in advance. That is, the mobile terminal 100 may transmit thestart time for requesting the motion information to the wearable device200, and the wearable device 200 may transmit to the mobile terminal 100the motion information included in the set time range from the starttime. For example, if the set time range is 100 ms, and the mobileterminal 100 transmits information of the start time (13:30:50.10) tothe wearable device 200, the wearable device 200 may sense the motioninformation for 100 ms from the start time (13:30:50.10) transmittedfrom the mobile terminal 100, and then, transmits the motion informationof the wearable device 200 to the mobile terminal 100. Operation S470 ofFIG. 4 corresponds to operation S320 of FIG. 3, and thus, detaileddescriptions thereof are omitted here.

In operation S480, the mobile terminal 100 compares the motion of themobile terminal 100 with the motion of the wearable device 200 that istransmitted from the wearable device 200, and determines whether themotion of the mobile terminal 100 and the motion of the wearable device200 are the same or similar. Operation S480 of FIG. 4 corresponds tooperation S330 of FIG. 3, and thus, detailed descriptions thereof areomitted here.

When the motion of the mobile terminal 100 and the motion of thewearable device 200 are determined to be same or similar, in operationS490, the mobile terminal 100 unlocks a lock mode of the mobile terminal100. Operation S490 of FIG. 4 corresponds to operation S340 of FIG. 3,and thus, detailed descriptions thereof are omitted here.

FIG. 5 is a flowchart illustrating an interaction between the mobileterminal 100 and the wearable device 200 to perform an unlockingoperation of the mobile terminal 100, according to an exemplaryembodiment.

Operations S510 to S555 of FIG. 5 correspond to operations S410 to S455of FIG. 4, and thus, detailed descriptions thereof are not provided.

Referring to FIG. 5, in operation S560, the mobile terminal 100determines whether the sensed motion of the mobile terminal 100 is equalto a motion set in advance, i.e., whether the sensed motion of themobile terminal 100 and the motion set in advance have a correlation ofa predetermined level or greater. For example, the predetermined motionmay be a motion of holding and lifting the mobile terminal 100, a motionof shaking the mobile terminal 100 to the left and right, a motion ofshaking the mobile terminal 100 up and down, a motion of moving themobile terminal 100 to the right, a motion of moving the mobile terminal100 to the left, and a motion of moving the mobile terminal 100 upward,but is not limited thereto.

When the sensed motion of the mobile terminal 100 is determined to beequal to the motion set in advance, in operation S565, the mobileterminal 100 requests the wearable device 200 for the motion informationof the wearable device 200, which is sensed by the wearable device 200.

Operations S570 to S590 of FIG. 5 correspond to operations S470 to S490of FIG. 4, and thus, detailed descriptions thereof are omitted.

FIG. 6 is a diagram showing an example in which the wearable device 200enters a lock mode or an unlock mode depending on whether a user wearsthe wearable device 200 or not, according to an exemplary embodiment.

In FIG. 6, the wearable device 200 is a watch, but is not limitedthereto. That is, the wearable device 200 according to one or moreexemplary embodiments may include a band, a bracelet, glasses, a helmet,a hat, a ring, shoes, earrings, a hair band, clothes, gloves, or athimble.

The wearable device 200 according to the exemplary embodiment may be ina lock mode or an unlock mode, depending on whether wearable device 200is worn or not. For example, if the user wears the wearable device 200,the wearable device 200 may be in a lock mode.

On the other hand, if the user is not wearing the wearable device 200,the lock mode of the wearable device 200 may be unlocked.

For example, as shown in FIG. 6, if the wearable device 200 is a watch,a wearing state of the wearable device 200 may be sensed based onwhether a buckle of the watch is coupled. Here, the wearable device 200senses a state of the buckle by using a pressure sensor, and if thebuckle of the wearable device 200 is coupled, the wearable device 200may recognize that the user is wearing the wearable device 200. However,if the buckle of the watch is not coupled, the wearable device 200 mayrecognize that the user is not wearing the wearable device 200.

Otherwise, the wearable device 200 may sense the wearing state thereofby using a ground sensor. For example, as shown in FIG. 6, if thewearable device 200 is a watch, a watchstrap may include the groundsensor, and when the watchstrap contacts the wrist of the user, thewearable device 200 may recognize that the user is wearing the wearabledevice 200.

Also, if the wearable device 200 is glasses, the glasses may include theground sensor at an end of the temples or at a nose pad. Thus, if theglasses contact the ears or nose of the user, the wearable device 200may recognize that the user is wearing the wearable device 200.

Also, if the wearable device 200 is a ring, the ring may include aground sensor at a band of the ring. Thus, if the user wears the ringand the ring contacts a finger of the user, the wearable device 200 mayrecognize that the user is wearing the wearable device 200.

For example, portion (a) of FIG. 6 denotes that the user is not wearingthe wearable device 200 (for example, a watch), and the wearable device200 may operate in the lock mode. Also, portion (b) of FIG. 6 denotesthat the user is wearing the wearable device 200, and the wearabledevice 200 may be unlocked. The lock mode of the wearable device 200 issimilar to that of the mobile terminal 100, and unlocking of the lockmode may be similar to that of the mobile terminal 100, but is notlimited thereto.

As shown in portion (a) of FIG. 6, if the wearable device 200 operatesin the lock mode, information such as the time and weather may only bedisplayed on the display of the wearable device 200.

As shown in portion (b) of FIG. 6, if the lock mode of the wearabledevice 200 is unlocked, the home screen may be displayed on the displayof the wearable device 200. Otherwise, menus of applications installedon the wearable device 200 may be displayed on the display of thewearable device 200. When an application is selected, the selectedapplication may be executed, but is not limited thereto.

FIG. 7 is a diagram showing an example of displaying a motion unlockfunction notification message 720 on the mobile terminal 100, accordingto an exemplary embodiment.

Referring to FIG. 7, the mobile terminal 100 according to the exemplaryembodiment may display the motion unlock function notification message720 if it is determined that the wearable device 200 connected to themobile terminal 100 is within a predetermined range.

For example, the mobile terminal 100 may recognize that the wearabledevice 200 is nearby based on short-range communication, and maydetermine whether the recognized wearable device 200 is a wearabledevice connected to the mobile terminal 100. Here, if the recognizedwearable device 200 is connected to the mobile terminal 100 and the lockmode of the wearable device 200 is unlocked, the mobile terminal 100 maydisplay the motion unlock function notification message 720 on themobile terminal 100.

The motion unlock function notification message 720 may be a messagenotifying that the lock mode of the mobile terminal 100 may be unlocked,if the mobile terminal 100 sense the same motion as the wearable device200 connected to the mobile terminal 100.

Otherwise, the motion unlock function notification message 720 may be amessage displaying a predetermined motion and notifying that the lockmode of the mobile terminal 100 may be unlocked if the predeterminedmotion is performed.

For example, the motion unlock function notification message 720 may bedisplayed as a text or an image on a pop-up window, as shown in FIG. 7,but is not limited thereto, that is, the motion unlock functionnotification message 720 may be output as a voice. Accordingly, the usermay easily recognize that the lock mode of the mobile terminal 100 maybe unlocked if the user is wearing the mobile terminal 100 and thewearable device 200 connected to the mobile terminal 100 and if the samemotion is sensed by the mobile terminal 100 and the wearable device 200.

FIGS. 8A to 9B are diagrams showing operations of unlocking a lock modeof the mobile terminal 100, if a user of the mobile terminal 100 and awearer of the wearable device 200 are the same person, according to anexemplary embodiment.

FIGS. 8A to 9B show that the user of the mobile terminal 100 holds themobile terminal 100 in his/her hand and wears the wearable device 200 onhis/her wrist. In FIGS. 8A to 9B, the wearable device 200 is a watchthat may be worn on the wrist, but is not limited thereto.

The mobile terminal 100 according to the exemplary embodiment may sensethe motion of the mobile terminal 100, and the wearable device 200according to the exemplary embodiment may sense the motion of thewearable device 200.

For example, as shown in FIGS. 8A, 8B, 9A, and 9B, if the user holds themobile terminal 100 in his/her hand and lifts the mobile terminal 100(the hand holding the mobile terminal 100 rotates by a predeterminedangle in a counter-clockwise direction), the mobile terminal 100 maysense a direction in which the mobile terminal 100 moves, a movingdistance of the mobile terminal 100, a rotating angle of the mobileterminal 100, and distances from the wearable device 200 before andafter moving.

Also, if the wearer of the wearable device 200 raises his/her handwearing the wearable device 200 (the wrist wearing the wearable device200 rotates by a predetermined angle in a counter-clockwise direction),the wearable device 200 may sense a direction in which the wearabledevice 200 moves, a moving distance of the wearable device 200, arotating angle of the wearable device 200, and distances from the mobileterminal 100 before and after moving. Also, the wearable device 200 maytransmit the motion information thereof to the mobile terminal 100.

The mobile terminal 100 may compare the motion information of the mobileterminal 100 with the motion information of the wearable device 200.Here, the mobile terminal 100 may determine that the motion of themobile terminal 100 is the same as the motion of the wearable device200, provided that the motion information of the mobile terminal 100(for example, a moving direction, a moving distance, a moving angle, avelocity, variation in the velocity, and distances from the wearabledevice 200 before and after moving) coincides with the motioninformation of the wearable device 200 (for example, a moving direction,a moving distance, a moving angle, a velocity, variation in thevelocity, and distances from the mobile terminal 100 before and aftermoving) within a predetermined range.

In addition, if the motion of the mobile terminal 100 is the same asthat of the wearable device 200 and the lock mode of the wearable device200 is unlocked, the mobile terminal 100 may display a home screen 820on the display thereof.

For example, as shown in FIG. 8A, the display of the mobile terminal 100may be in an inactivated state 810. For example, the inactivated state810 may be a turned-off state of the display of the mobile terminal 100.However, the display of the wearable device 200 may be in a turned-onstate (activated state). If the motion of the mobile terminal 100 is thesame as the motion of the wearable device 200 and the lock mode of thewearable device 200 is unlocked in a state where the mobile terminal 100is in the inactivated state, the mobile terminal 100 may display thehome screen 820 on the display thereof.

The home screen 820 may include icons corresponding to predeterminedapplications or a preset image, but is not limited thereto.

Otherwise, as shown in FIG. 8B, in a state where the display of themobile terminal 100 and the display of the wearable device 200 are bothturned off (inactivated states), if the motion of the mobile terminal100 is the same as the motion of the wearable device 200 and the lockmode of the wearable device 200 is unlocked, the mobile terminal 100 maydisplay the home screen 820 on the display thereof.

Otherwise, as shown in FIG. 9A, the mobile terminal 100 may display alock mode screen 910 on the display thereof. The lock mode screen 910may include a screen to which a password for unlocking the lock mode maybe input. For example, the password for unlocking the lock mode may be aline pattern connecting a plurality of buttons, or a password consistingof numbers or characters, but is not limited thereto. Also, the displayof the wearable device 200 may be in a turned on state (activatedstate).

If the motion of the mobile terminal 100 is the same as the motion ofthe wearable device 200 and the lock mode of the wearable device 200 isunlocked in a state where the lock mode screen 910 is displayed on themobile terminal 100, the mobile terminal 100 may display a home screen920 on the display thereof.

Otherwise, as shown in FIG. 9B, in a state where the lock mode screen910 is displayed on the display of the mobile terminal 100 and thedisplay of the wearable device 200 is in a turned off state (inactivatedstate), if the motion of the mobile terminal 100 is the same as themotion of the wearable device 200 and the lock mode of the wearabledevice 200 is unlocked, the mobile terminal 100 may display the homescreen 920 on the display of the mobile terminal 100.

If the lock mode of the wearable device 200 is unlocked and the mobileterminal 100 recognizes that the user of the mobile terminal 100 iswearing the wearable device 200, the mobile terminal 100 may unlock thelock mode thereof without additionally requesting input of the passwordfor unlocking the lock mode thereof.

Accordingly, in a case where a user holds the mobile terminal 100 inhis/her hand while wearing the wearable device 200 on his/her wrist ofthe hand holding the mobile terminal 100, if the lock mode of thewearable device 200 is unlocked, the lock mode of the mobile terminal100 may be unlocked only by a motion without passing through apredetermined authentication process (for example, inputting password orpattern) to unlock the lock mode of the mobile terminal 100.

FIG. 10 is a flowchart illustrating a method of performing a userauthentication in the mobile terminal 100, in a case where the wearabledevice 200 performs the user authentication, according to an exemplaryembodiment, and FIG. 11 is a diagram illustrating the method of FIG. 10.

According to the mobile terminal 100 of the exemplary embodiment, in acase where the motion of the mobile terminal 100, sensed by the mobileterminal 100, is the same as the motion of the wearable device 200,sensed by the wearable device 200, connected to the mobile terminal 100,if the wearable device 200 has already performed the userauthentication, the mobile terminal 100 may perform the userauthentication without inputting user authentication information to themobile terminal 100. This will be described below in more detail.

Referring to FIG. 10, the wearable device 200 may perform a userauthentication process in operation S1010.

The user of the wearable device 200 may input user authenticationinformation (for example, user ID and password) to the wearable device200 to perform user authentication with respect to a network or system.The user authentication denotes that the user is authorized to accessthe network or system.

For example, the user of the wearable device 200 may log-in to a siteproviding a service by using the user authentication information.

Referring back to FIG. 10, the wearable device 200 may transmitidentification information to the mobile terminal 100 that is within adistance range set in advance, in operation S1020.

The mobile terminal 100 may recognize the wearable device 200 that iswithin the preset distance range from the mobile terminal 100, inoperation S1030.

Also, the mobile terminal 100 may determine whether the recognizedwearable device 200 is connected thereto in operation S1040.

In addition, in the flowchart of FIG. 10, operation S1010, in which thewearable device 200 displays a web page, is prior to operations S1020 toS1040, but is not limited thereto. That is, operation S1010 may beperformed between operation S1020 and operation S1040, or may beperformed between operation S1040 and operation S1050.

If the recognized wearable device 200 is connected to the mobileterminal 100, the mobile terminal 100 senses the motion thereof toacquire the motion information of the mobile terminal 100, in operationS1050.

In addition, the wearable device 200 senses the motion thereof toacquire the motion information of the wearable device 200 in operationS1055. Here, the wearable device 200 may sense the motion of thewearable device 200 at the same time when the mobile terminal 100 sensesthe motion thereof (operation S1050).

The mobile terminal 100 may request the wearable device 200 for themotion information of the wearable device 200 in operation S1060.

The wearable device 200 may transmit the motion information thereof tothe mobile terminal 100 in operation S1065.

The mobile terminal 100 may determine whether the motion of the mobileterminal 100 is the same as the motion of the wearable device 200, inoperation S1070.

The above described operations S1020 to S1070 of FIG. 10 correspond tooperations S420 to S480 of FIG. 4, and thus, detailed descriptionsthereof are omitted here.

If it is determined that the motion of the mobile terminal 100 is thesame as the motion of the wearable device 200, the mobile terminal 100may receive user authentication information from the wearable device200, in operation S1080.

The mobile terminal 100 may access the network or system authenticatedby the wearable device 200 based on the user authentication informationtransmitted from the wearable device 200, in operation S1090.

For example, referring to FIG. 11, the user authentication is alreadyperformed by the wearable device 200 with respect to a social networkservice (SNS) page, and the wearable device 200 is logged-in the SNSpage. Then, the mobile terminal 100 may display a screen 1110 forreceiving input of the user authentication information to log-in to theSNS page. Here, if the motion of the mobile terminal 100 is the same asthe motion of the wearable device 200, the mobile terminal 100 maylog-in to the SNS page, and display a page 1120 corresponding to the SNSpage.

Accordingly, if the user has already authenticated on a site by usingthe wearable device 200, the user authentication may be performed on thesite only by performing a motion (for example, holding and lifting themobile terminal 100) without inputting the user authenticationinformation to the mobile terminal 100.

FIG. 12 is a flowchart illustrating a method of displaying a web pagedisplayed on the wearable device 200, on the mobile terminal 100, andFIG. 13 is a diagram illustrating the method of FIG. 12.

The mobile terminal 100 according to the exemplary embodiment maydisplay a web page that is currently being displayed on the wearabledevice 200, on the mobile terminal 100, if the motion of the mobileterminal 100, sensed by the mobile terminal 100, is the same as themotion of the wearable device 200, sensed by the wearable device 200,connected to the mobile terminal 100. This will be described in detailas follows.

Web applications through which web browsing may be performed may beinstalled on the mobile terminal 100 and the wearable device 200according to the exemplary embodiment.

Referring to FIG. 12, the wearable device 200 may display a web page inoperation S1210.

For example, the user may execute a web application by using thewearable device 200, and when the web application is executed, a webpage 1310 may be displayed on the display of the wearable device 200 asshown in FIG. 13. The web page 1310 is a page for representing webdocuments on the Internet, and may represent various pieces of content.

Referring back to FIG. 12, the wearable device 200 may transmitidentification information to the mobile terminal 100 that is within adistance range set in advance, in operation S1220.

The mobile terminal 100 may recognize the wearable device 200 that iswithin the distance range set in advance from the mobile terminal 100,in operation S1230.

Also, the mobile terminal 100 may determine whether the recognizedwearable device 200 is connected thereto, in operation S1240.

In addition, operation S1210, in which the wearable device 200 displaysthe web page, is prior to operations S1220 to S1240 in the flowchart ofFIG. 12, but is not limited thereto. That is, operation S1210 may beperformed between operations S1220, S1230, and S1240, or may beperformed between operations S1240 and S1250.

If the recognized wearable device 200 is connected to the mobileterminal 100, the mobile terminal 100 may sense the motion thereof toacquire the motion information of the mobile terminal 100, in operationS1250.

In addition, the wearable device 200 may acquire motion informationthereof by sensing the motion of the wearable device 200, in operationS1255. Here, the wearable device 200 may sense the motion of thewearable device 200 at the same time when the mobile terminal 100 sensesthe motion of the mobile terminal 100 (operation S1250).

The mobile terminal 100 may request the wearable device 200 for themotion information of the wearable device 200, in operation S1260.

The wearable device 200 may transmit the motion information of thewearable device 200, sensed by the wearable device 200, to the mobileterminal 100, in operation S1265.

The mobile terminal 100 may determine whether the motion of the mobileterminal 100 is the same as the motion of the wearable device 200, inoperation S1270.

Operations S1220 to S1270 of FIG. 12 correspond to operations S420 toS480 of FIG. 4, and thus, detailed descriptions thereof are omitted.

If it is determined that the motion of the mobile terminal 100 is thesame as the motion of the wearable device 200, the mobile terminal 100may receive information about the web page that is currently beingdisplayed on the wearable device 200 from the wearable device 200, inoperation S1280.

For example, the mobile terminal 100 may receive address information ofthe web page that is currently being displayed on the wearable device200.

The mobile terminal 100 may display a web page 1330 that is the same asthe web page currently being displayed on the display of the wearabledevice 200, on the display of the mobile terminal 100, based on the webpage information transmitted from the wearable device 200, in operationS1290.

For example, referring to FIG. 13, the mobile terminal 100 that is in aninactivated state 1320 may execute the web application and display theweb page 1330 that is the same as the web page currently being displayedon the wearable device 200, based on the web page informationtransmitted from the wearable device 200.

Here, the web page displayed on the mobile terminal 100 and the web pagedisplayed on the wearable device 200 may vary depending on kinds of thedevices displaying the web pages. For example, the mobile terminal 100may display the web page of a version for the mobile terminal 100, andthe wearable device 200 may display the web page of a version for thewearable device 200.

In addition, the wearable device 200 may switch the display of thewearable device 200 into an inactivated state or may display a screenincluding information (for example, time and weather) on the display ofthe wearable device 200, but is not limited thereto.

Accordingly, if the user browsing the web through the wearable device200 wants to browse the web through the mobile terminal 100, the webpage that is currently being displayed on the wearable device 200 may bedisplayed on the mobile terminal 100 only by performing a motion (forexample, holding and lifting the mobile terminal 100) without inputtingan address of the web page into the mobile terminal 100.

Also, the mobile terminal 100 may receive web browsing history data ofthe wearable device 200. Accordingly, the mobile terminal 100 is capableof displaying, on the mobile terminal 100, a previous web page that hasbeen displayed on the wearable device 200, as well as the web page thatis the same as the web page currently being displayed on the wearabledevice 200, if a back button input (an input for moving to the previouspage of the current web page) is received.

FIG. 14 is a flowchart illustrating a method of making a phone call byusing the mobile terminal 100 if the wearable device 200 receives a callconnection request, according to an exemplary embodiment, and FIG. 15 isa diagram illustrating the method of FIG. 14.

If the motion of the mobile terminal 100, sensed by the mobile terminal100, is the same as the motion of the wearable device 200, sensed by thewearable device, connected to the mobile terminal 100, the mobileterminal 100 may make a phone call that the wearable device 200 wasrequested. This will be described in more detail later.

Phone call applications that may make phone calls to external devicesmay be installed on the mobile terminal 100 and the wearable device 200according to the exemplary embodiment.

Referring to FIG. 14, the wearable device 200 may receive a callconnection request from an external device, in operation S1410.

For example, if the wearable device 200 receives a call connectionrequest, a call connection request screen 1510 may be displayed on thewearable device 200 as shown in FIG. 15.

Here, the call connection request screen 1510 may indicateidentification information of a counterpart device that has requestedthe call connection. The identification information of the counterpartdevice may include a phone number of the counterpart device, a user nameof the counterpart device, or a nickname. Also, the call connectionrequest screen 1510 may include a connection button or a block button.

In addition, if the wearable device 200 receives the call connectionrequest, the mobile terminal 100 may simultaneously receive the callconnection request from the same external device. However, one or moreexemplary embodiments are not limited thereto.

Referring back to FIG. 14, the wearable device 200 may transmitidentification information to the mobile terminal 100 that is in adistance range set in advance, in operation S1420.

The mobile terminal 100 may recognize the wearable device 200 that is inthe preset distance range from the mobile terminal 100, in operationS1430.

Also, the mobile terminal 100 may determine whether the recognizeddevice 200 is connected thereto, in operation S1440.

In addition, in the flowchart of FIG. 14, operation S1410, in which thewearable device 200 receives the call connection request, is prior tooperations S1420 to S1440, but is not limited thereto. That is,operation S1410 may be performed between operations S1420, S1430, andS1440, or may be performed between operations S1440 and S1450.

If the recognized wearable device 200 is a wearable device connected tothe mobile terminal 100, the mobile terminal 100 may sense the motion ofthe mobile terminal 100 to acquire the motion information of the mobileterminal 100, in operation S1450.

In addition, the wearable device 200 may acquire the motion informationof the wearable device 200 by sensing the motion of the wearable device200, in operation S1455. Here, the wearable device 200 may sense themotion of the wearable device 200 at the same time when the mobileterminal 100 senses the motion of the mobile terminal 100 (operationS1450).

The mobile terminal 100 may request the wearable device 200 for themotion information of the wearable device 200, in operation S1460.

The wearable device 200 may transmit the motion information of thewearable device 200 to the mobile terminal 100, in operation S1465.

The mobile terminal 100 may determine whether the motion of the mobileterminal 100 is the same as the motion of the wearable device 200, inoperation S1470.

Operations S1420 to S1470 of FIG. 14 correspond to operations S420 toS480 of FIG. 4, and thus, detailed descriptions thereof are omitted.

If it is determined that the motion of the mobile terminal 100 is thesame as the motion of the wearable device 200, the wearable device 200may transmit call connection information corresponding to the callconnection request that the wearable device 200 has received, to themobile terminal 100, in operation S1480.

For example, the mobile terminal 100 may receive the identificationinformation of the counterpart device that requested the wearable device200 for the call connection, and may display a call connection requestscreen 1530 as shown in FIG. 15.

The mobile terminal 100 may connect the call with the counterpart devicethat has requested the wearable device 200 for the call connection basedon the call connection information, in operation S1490.

Accordingly, if the wearable device 200 displays the call connectionscreen, the user may receive the call only by performing a motion (forexample, holding and lifting the mobile terminal 100) without inputtinga call connection button to the mobile terminal 100.

FIG. 16 is a flowchart illustrating a method of performing a phone callwith an external device by using the mobile terminal 100, while thephone call is made with the external device by using the wearable device200, according to an exemplary embodiment, and FIG. 17 is a diagramillustrating the method of FIG. 16.

If the motion of the mobile terminal 100, sensed by the mobile terminal100, is the same as the motion of the wearable device 200, sensed by thewearable device 200, connected to the mobile terminal 100, the mobileterminal 100 according to the exemplary embodiment may perform the phonecall that has been made by the wearable device 200. This will bedescribed in more detail as follows.

Referring to FIG. 16, the wearable device 200 may receive a callconnection request from an external device in operation S1610.

For example, if the wearable device 200 receives the call connectionrequest, a call connection request screen 1710 may be displayed as shownin FIG. 17. In addition, the user may select a call connection buttonincluded in the call connection request screen 1710 to connect the callwith the external device, in operation S1615.

Referring to FIG. 16, the wearable device 200 may transmitidentification information to the mobile terminal 100 that is within adistance range set in advance, in operation S1620.

The mobile terminal 100 may recognize the wearable device 200 that is inthe distance range set in advance from the mobile terminal 100, inoperation S1630.

Also, the mobile terminal 100 may determine whether the recognizeddevice 200 is a wearable device connected thereto, in operation S1640.

In addition, in the flowchart of FIG. 16, operation S1610, in which thewearable device 200 receives the call connection request, is prior tooperations S1620 to S1640, but is not limited thereto. That is,operation S1610 may be performed between operations S1620, S1630, andS1640, or may be performed between operations S1640 and S1650.

If the recognized wearable device 200 is connected to the mobileterminal 100, the mobile terminal 100 may sense the motion of the mobileterminal 100 to acquire the motion information of the mobile terminal100, in operation S1650.

In addition, the wearable device 200 may acquire the motion informationof the wearable device 200 by sensing the motion of the wearable device200, in operation S1655. Here, the wearable device 200 may sense themotion of the wearable device 200 at the same time when the mobileterminal 100 senses the motion of the mobile terminal 100 (operationS1650).

The mobile terminal 100 may request the wearable device 200 for themotion information of the wearable device 200, in operation S1660.

The wearable device 200 may transmit the motion information of thewearable device 200 to the mobile terminal 100, in operation S1665.

The mobile terminal 100 may determine whether the motion of the mobileterminal 100 is the same as the motion of the wearable device 200, inoperation S1670.

Operations S1620 to S1670 of FIG. 16 correspond to operations S420 toS480 of FIG. 4, and thus, detailed descriptions thereof are omitted.

If it is determined that the motion of the mobile terminal 100 is thesame as the motion of the wearable device 200, the wearable device 200may transmit call connection information to the mobile terminal 100, inoperation S1680.

For example, the mobile terminal 100 may receive identificationinformation of the counterpart device that currently connects the callwith the wearable device 200.

The mobile terminal 100 may connect a call to the counter device that iscurrently calling with the wearable device 200, based on the callconnection information transmitted from the wearable device 200, inoperation S1690. Here, when the call connection between the mobileterminal 100 and the counterpart device is performed, the callconnection between the wearable device 200 and the counterpart devicemay be terminated. For example, the mobile terminal 100 may transmit thecall connection information to a base station or a server of acommunication provider, and the base station or the server of thecommunication provider may connect a call between the counterpart devicecalling with the wearable device 200 and the mobile terminal 100 (forexample, routing) based on the call connection information that hastransmitted from the mobile terminal 100.

Otherwise, the mobile terminal 100 may be used as a call interface whilethe call connection between the wearable device 200 and the counterpartdevice is maintained. For example, the wearable device 200 may transmita voice signal transmitted from the counterpart device to the mobileterminal 100 via the base station or the server of the communicationprovider. The mobile terminal 100 may output the voice signaltransmitted from the wearable device 200, and may transmit a voicesignal input into the mobile terminal 100 to the wearable device 200.The wearable device 200 may transmit the voice signal to the counterpartdevice via the base station or the server of the communication provider.

Accordingly, if the user wants to make a call by using the mobileterminal 100 instead of using the wearable device 200 when the user ismaking a call with a counterpart (user of the external device) by usingthe wearable device 200, the user may perform a call connection with theexternal device only by performing a motion (for example, holding andlifting the mobile terminal 100). Therefore, the user does not need tohang up on the counterpart while using the wearable device 200 and tomake a call again by using the mobile terminal 100.

FIG. 18 is a flowchart illustrating a method of executing an applicationrelated to a notification message in the mobile terminal 100, when thewearable device 200 receives the notification message, according to anexemplary embodiment, and FIGS. 19 and 20 are diagrams illustrating themethod of FIG. 18.

If the motion of the mobile terminal 100, sensed by the mobile terminal100, is the same as the motion of the wearable device 200, sensed by thewearable device 200, connected to the mobile terminal 100, the mobileterminal 100 according to the exemplary embodiment may execute anapplication related to a notification message that the wearable device200 has received. This will be described in more detail as follows.

Referring to FIG. 18, the wearable device 200 may display a notificationmessage in operation S1810.

For example, as shown in FIG. 19, the wearable device 200 may receive anotification message 1910 relating to a game application and display thenotification message 1910 on the display. Otherwise, as shown in FIG.20, the wearable device 200 may receive a notification message 2010relating to an SNS application and display the notification message 2010on the display. However, one or more exemplary embodiments are notlimited thereto, that is, the wearable device 200 may receivenotification messages relating to various applications and display thenotification messages on the display. Also, the notification message maybe displayed as a pop-up window.

Referring back to FIG. 18, the wearable device 200 may transmitidentification information to the mobile terminal 100 that is within adistance range set in advance, in operation S1820.

The mobile terminal 100 may recognize the wearable device 200 existingwithin the preset distance range from the mobile terminal 100, inoperation S1830.

Also, the mobile terminal 100 may determine whether the recognizedwearable device 200 is a wearable device connected to the mobileterminal 100, in operation S1840.

In addition, in the flowchart of FIG. 18, operation S1810, in which thewearable device 200 displays a notification message, is prior tooperations S1820 to S1840, but is not limited thereto. That is,operation S1810 may be performed between operations S1820, S1830, andS1840, or may be performed between operations S1840 and S1850.

If the recognized wearable device 200 is a wearable device connected tothe mobile terminal 100, the mobile terminal 100 may sense the motion ofthe mobile terminal 100 to acquire the motion information of the mobileterminal 100, in operation S1850.

In addition, the wearable device 200 may sense the motion of thewearable device 200 to acquire the motion information of the wearabledevice 200 in operation S1855. Here, the wearable device 200 may sensethe motion of the wearable device 200 at the same time when the mobileterminal 100 senses the motion of the mobile terminal (operation S1850).

The mobile terminal 100 may request the wearable device 200 for themotion information of the wearable device 200 in operation S1860.

The wearable device 200 may transmit the motion information of thewearable device 200 to the mobile terminal 100, in operation S1865.

The mobile terminal 100 may determine whether the motion of the mobileterminal 100 is the same as the motion of the wearable device 200, inoperation S1870.

Operations S1820 to S1870 of FIG. 18 correspond to operations S420 toS480 of FIG. 4, and thus, detailed descriptions thereof are omitted.

If it is determined that the motion of the mobile terminal 100 is thesame as the motion of the wearable device 200, the wearable device 200may transmit application information related to the notification messageto the mobile terminal 100, in operation S1880.

For example, the application information related to the notificationmessage may include name of the application, a kind of the application,version information of the application, or execution information of theapplication (information for executing the application).

The mobile terminal 100 may execute the application corresponding to thenotification message displayed on the wearable device 200, based on theapplication information related to the notification message transmittedfrom the wearable device 200, in operation S1890.

Here, the application related to the notification message displayed onthe wearable device 200 may be already installed on the mobile terminal100.

For example, the mobile terminal 100 may execute a game application 1930related to the game notification message 1910 displayed on the wearabledevice 200, as shown in FIG. 19.

Accordingly, if the user wants to execute the application related to thenotification message displayed on the wearable device 200 in the mobileterminal 100, the user does not need to select and execute theapplication on the mobile terminal 100, but may execute the application,which is related to the notification message displayed on the wearabledevice 200, in the mobile terminal 100 only by performing a motion (forexample, holding and lifting the mobile terminal 100).

FIG. 20 is a diagram illustrating a method of executing an SNSapplication 2030 in the mobile terminal 100 when the notificationmessage 2010 relating to the SNS application is displayed on thewearable device 200, according to the exemplary embodiment.

As shown in FIG. 20, the wearable device 200 may receive and display thenotification message 2010 regarding an SNS application.

For example, the wearable device 200 may display a message notifyingthat a social friend included in the same social group as the user hasuploaded a new photo on the SNS.

As described in above operations S1850 to S1870, if it is determinedthat the motion of the mobile terminal 100 is the same as the motion ofthe wearable device 200, the mobile terminal 100 may receive SNSapplication information and SNS notification message information fromthe wearable device 200.

The SNS application information may include a name of the SNSapplication, the kind of the SNS application, version information of theSNS application, or execution information of the SNS application(information for executing the SNS application). The SNS notificationmessage information may include information about a social page relatingto the notification message 2010 displayed on the wearable device 200(for example, if the notification message 2010 includes updated contenton a web page of the social friend, information about the web pageaddress of the social page).

The mobile terminal 100 may execute the application 2030 related to theSNS notification message 2010 displayed on the wearable device 200,based on the SNS application information and the SNS notificationmessage information transmitted from the wearable device 200.

For example, as shown in FIG. 20, if the notification message 2010displayed on the wearable device 200 notifies that the social friendincluded in the same social group as that of the user of the wearabledevice 200 has uploaded a new photo on the SNS site, the mobile terminal100 may execute the SNS application 2030 corresponding to thenotification message 2010 to display a web page of the social friend ora web page including the photo that the social friend has uploaded.However, one or more exemplary embodiments are not limited thereto.

Accordingly, if the user wants to identify the content regarding the SNSnotification message 2010, which is displayed on the wearable device200, on the mobile terminal 100, the user does not need to select andexecute the SNS application 2030 in the mobile terminal 100, but onlyperforms a motion (for example, holding and lifting the mobile terminal100) to check the content related to the notification message 2010displayed on the wearable device 200 via the mobile terminal 100.

FIG. 21 is a flowchart illustrating a method of displaying a message onthe mobile terminal 100, when the wearable device 200 receives themessage, according to an exemplary embodiment, and FIG. 22 is a diagramillustrating the method of FIG. 21.

If the motion of the mobile terminal 100, sensed by the mobile terminal100, is the same as the motion of the wearable device 200, sensed by thewearable device 200, the mobile terminal 100 may display the messagethat the wearable device 200 has received. This will be described inmore detail as follows.

Referring to FIG. 21, the wearable device 200 may receive a message inoperation S2110.

The message may include a text message, an instant message, a chattingmessage, or an e-mail transmitted from an external device. Also, thewearable device 200 may output an alarm when receiving the message. Forexample, as shown in FIG. 22, a notification message 2210 indicating thereceipt of the message may be displayed on the display of the wearabledevice 200, or an alarm or vibration may be output. However, one or moreexemplary embodiments are not limited thereto.

Referring to FIG. 21, the wearable device 200 may transmitidentification information to the mobile terminal 100 that is within adistance range set in advance, in operation S2120.

The mobile terminal 100 may recognize the wearable device 200 existingwithin the distance range set in advance from the mobile terminal 100,in operation S2130.

Also, the mobile terminal 100 may determine whether the recognizedwearable device 200 is connected to the mobile terminal 100, inoperation S2140.

In addition, in the flowchart of FIG. 21, operation S2110, in which thewearable device 200 receives the message, is prior to operations S2120to S2140, but is not limited thereto. That is, operation S2110 may beperformed between operations S2120, S2130, and S2140, or may beperformed between operations S2140 and S2150.

If the recognized wearable device 200 is a wearable device connected tothe mobile terminal 100, the mobile terminal 100 may sense the motion ofthe mobile terminal 100 to acquire the motion information of the mobileterminal 100, in operation S2150.

In addition, the wearable device 200 may sense the motion of thewearable device 200 to acquire the motion information of the wearabledevice 200 in operation S2155. Here, the wearable device 200 may sensethe motion of the wearable device 200 at the same time when the mobileterminal 100 senses the motion of the mobile terminal (operation S2150).

The mobile terminal 100 may request the wearable device 200 for themotion information of the wearable device 200, in operation S2160.

The wearable device 200 may transmit the motion information of thewearable device 200 to the mobile terminal 100, in operation S2165.

The mobile terminal 100 may determine whether the motion of the mobileterminal 100 is the same as the motion of the wearable device 200, inoperation S2170.

Operations S2120 to S2170 of FIG. 21 correspond to operations S420 toS480 of FIG. 4, and thus, detailed descriptions thereof are omitted.

If it is determined that the motion of the mobile terminal 100 is thesame as the motion of the wearable device 200, the wearable device 200may transmit message information to the mobile terminal 100, inoperation S2180.

The mobile terminal 100 may display the message that the wearable device200 has received, based on the message information transmitted from thewearable device 200, in operation S2190.

Referring to FIG. 22, an application related to the message transmittedfrom the wearable device 200 may be a message application 2230 that hasbeen already installed on the mobile terminal 100, and the mobileterminal 100 may execute the message application 2230 to display themessage transmitted from the wearable device 200.

Accordingly, if the user wants to check the message that the wearabledevice 200 has received via the mobile terminal 100, the user does notneed to select and execute the message application on the mobileterminal 100, but only performs a motion (for example, holding andlifting the mobile terminal 100) to check the message that the wearabledevice 200 has received.

FIG. 23 is a flowchart illustrating a method of reproducing content inthe mobile terminal 100, when the content is being reproduced by thewearable device 200, according to the exemplary embodiment, and FIG. 24is a diagram illustrating the method of FIG. 23.

If the motion of the mobile terminal 100, sensed by the mobile terminal100, is the same as the motion of the wearable device 200, sensed by thewearable device 200, the mobile terminal 100 according to the exemplaryembodiment may successively reproduce the content that is currentlybeing reproduced by the wearable device 200. This will be described inmore detail as follows.

Referring to FIG. 23, the wearable device 200 may reproduce a piece ofcontent in operation S2310.

The wearable device 200 may reproduce the content stored therein, or apiece of content uploaded in an external server such as a web server oran SNS server. Here, the content may include text, images, audio, orvideo.

For example, as shown in FIG. 24, the wearable device 200 may reproducea video 2410 stored in the wearable device 200 or reproduce a videostored in a web server after downloading the video from the web server.

Referring back to FIG. 23, the wearable device 200 may transmitidentification information to the mobile terminal 100 that is within apreset distance range, in operation S2320.

The mobile terminal 100 may recognize the wearable device 200 existingwithin the preset distance range from the mobile terminal 100, inoperation S2330.

Also, the mobile terminal 100 may determine whether the recognizedwearable device 200 is a wearable device connected to the mobileterminal 100, in operation S2340.

In addition, in the flowchart of FIG. 23, operation S2310, in which thewearable device 200 reproduces the content, is prior to operations S2320to S2340, but is not limited thereto. That is, operation S2110 may beperformed between operations S2320, S2330, and S2340, or may beperformed between operations S2340 and S2350.

If the recognized wearable device 200 is a wearable device connected tothe mobile terminal 100, the mobile terminal 100 may sense the motion ofthe mobile terminal 100 to acquire the motion information of the mobileterminal 100, in operation S2350.

In addition, the wearable device 200 may acquire the motion informationof the wearable device by sensing the motion of the wearable device 200,in operation S2355. Here, the wearable device 200 may sense the motionof the wearable device 200 at the same time when the mobile terminal 100senses the motion of the mobile terminal 100 (operation S2350).

The mobile terminal 100 may request the wearable device 200 for themotion information of the wearable device 200, in operation S2360.

The wearable device 200 may transmit the motion information sensed bythe wearable device 200 to the mobile terminal 100, in operation S2365.

The mobile terminal 100 may determine whether the motion of the mobileterminal 100 is the same as the motion of the wearable device 200, inoperation S2370.

Above described operations S2320 to S2370 of FIG. 23 correspond tooperations S420 to S480 of FIG. 4, and thus, detailed descriptionsthereof are omitted here.

If it is determined that the motion of the mobile terminal 100 is thesame as the motion of the wearable device 200, the wearable device 200may transmit content reproduction information of the content that iscurrently being reproduced on the wearable device 200 to the mobileterminal 100, in operation S2380.

Here, the content reproduction information is information forreproducing the content, and may include kind of the content, contentname, information about a program for reproducing the content, versioninformation of the program for reproducing the content, amountinformation, information about play time of the content, and informationabout a location where the content is stored (for example, informationabout the storage location on the mobile terminal 100 or informationabout an address of a server storing the content).

The mobile terminal 100 may continuously reproduce the content that iscurrently being reproduced on the wearable device 200, based on thecontent reproduction information, in operation S2390.

For example, the mobile terminal 100 may reproduce a video 2430 on themobile terminal 100, wherein the video 2430 is the same as the video2410 that is currently being reproduced on the wearable device 200, asshown in FIG. 24. Here, the mobile terminal 100 may reproduce the video2430 continuously from a point that is reproduced on the wearable device200 last, based on the content reproduction time information (forexample, video reproduction time information) transmitted from thewearable device 200.

Accordingly, if the user who has viewed the video on the wearable device200 wants to view the video on the mobile terminal 100, the user doesnot need to search for the video to reproduce the video on the mobileterminal 100, but only performs a motion (for example, holding andlifting the mobile terminal 100) to reproduce, on the mobile terminal100, the video that has been reproduced on the wearable device 200.

FIG. 25 is a diagram illustrating a method of displaying content that iscurrently being displayed on the wearable device 200, on the mobileterminal 100, according to an exemplary embodiment.

As shown in FIG. 25, the wearable device 200 may display an image 2510.

As described above in operations S2350 to S2370 in FIG. 23, the mobileterminal 100 may receive information about the image 2510 that iscurrently being displayed on the wearable device 200 from the wearabledevice 200, if it is determined that the motion of the mobile terminal100 is the same as the motion of the wearable device 200.

Based on the image information, the mobile terminal 100 may display theimage that is currently being displayed on the wearable device 200. Forexample, as shown in FIG. 25, the mobile terminal 100 may expand theimage 2510 displayed on the wearable device 200, and then, may displayan expanded image 2530 on the mobile terminal 100.

Accordingly, if the user wants to display, on the mobile terminal 100,the image currently displayed on the wearable device 200, the user doesnot need to search for the image in the mobile terminal 100 to displaythe image on the mobile terminal 100, but only performs a motion (forexample, holding and lifting the mobile terminal 100) to expand theimage displayed on the wearable device 200 and display the expandedimage on the mobile terminal 100.

FIG. 26 is a diagram illustrating a method of transferring data on thewearable device 200 to the mobile terminal 100, according to anexemplary embodiment.

The wearable device 200 according to the exemplary embodiment mayreceive a user input for selecting a text, an image, a video, or anaudio file that is to be transferred to the mobile terminal 100.

Here, the text, the image, the video, or the audio file to betransmitted to the mobile terminal 100 may be stored in the wearabledevice 200, that is, images captured by the wearable device 200 or anaudio file recorded by using the wearable device 200.

For example, as shown in FIG. 26, the user of the wearable device 200may select an image 2610 to be transmitted to the mobile terminal 100,and the wearable device 200 may display the selected image 2610 on thedisplay.

If it is determined that the motion of the mobile terminal 100 is thesame as the motion of the wearable device 200, the mobile terminal 100may transmit the data of the wearable device 200 to the mobile terminal100.

The mobile terminal 100 may determine a location to store the datatransmitted from the wearable device 200, based on a kind of the data.For example, if the mobile terminal 100 receives the image 2610 as shownin FIG. 26, the mobile terminal 100 may store a received image 2630 in aphoto application (for example, a gallery). Here, the data transmittedfrom the wearable device 200 may be automatically stored or may bestored according to a request from the user.

FIG. 27 is a flowchart illustrating a method of performing apredetermined operation by the mobile terminal 100, when a bio signalsensed by the mobile terminal 100 is the same as a bio signal sensed bythe wearable device 200, according to an exemplary embodiment, and FIG.28 is a diagram illustrating the method of FIG. 27.

Referring to FIG. 27, the wearable device 200 may transmitidentification information to the mobile terminal 100 that is within adistance range set in advance, in operation S2710.

The mobile terminal 100 may recognize the wearable device 200 that iswithin a distance range set in advance from the mobile terminal 100, inoperation S2720.

Also, the mobile terminal 100 may determine whether the recognizedwearable device 200 is connected to the mobile terminal, in operationS2730.

Operations S2710 to S2730 of FIG. 27 correspond to operation S420 toS440 of FIG. 4, and thus, detailed descriptions thereof are omittedhere.

If the recognized wearable device 200 is connected to the mobileterminal 100, the mobile terminal 100 may acquire bio information bysensing a bio signal of the user of the mobile terminal 100, inoperation S2740.

For example, the mobile terminal 100 may include a bio signal sensor forsensing the bio signal of the user of the mobile terminal 100. Here, thebio signal sensor is included in a portion contacting the hand of theuser when the user holds the mobile terminal 100 in his/her hand asshown in FIG. 28, and thus, the bio signal may be automatically sensedwhen the user holds the mobile terminal 100 in his/her hand.

Accordingly, the mobile terminal 100 may measure a temperature, a pulse,an electrocardiogram (ECG), a heart rate, or a blood pressure of theuser by using the bio signal sensor.

Also, the wearable device 200 connected to the mobile terminal 100 mayacquire bio information by sensing a bio signal of the user wearing thewearable device 200, in operation S2745.

For example, the wearable device 200 may include a bio signal sensor forsensing the bio signal of the user. Here, the bio signal sensor isincluded in a portion contacting the body of the user when the userwears the wearable device 200 as shown in FIG. 28, and thus, the biosignal may be automatically sensed when the user wears the wearabledevice 200.

Accordingly, the wearable device 200 may measure a temperature, a pulse,an ECG, a heart rate, or a blood pressure of the user by using the biosignal sensor.

In addition, the mobile terminal 100 may request the wearable device 200for the bio information of the user wearing the wearable device 200, inoperation S2750.

The wearable device 200 may transmit the bio information of the userwearing the wearable device 200 to the mobile terminal 100, in operationS2760. For example, the wearable device 200 may transmit the bio signalinformation sensed by the wearable device 200 to the mobile terminal 100via short-range communication. Here, short-range communication may be aWi-Fi method, an NFC, a Bluetooth method, an infrared ray method, or aZigBee method, but is not limited thereto.

The mobile terminal 100 compares the bio information of the user of themobile terminal 100 with the bio information of the user wearing thewearable device 200 to determine whether the bio signal of the user ofthe mobile terminal 100 is the same as the bio signal of the userwearing the wearable device 200, in operation S2770.

Here, the bio information of the user of the mobile terminal 100 and thebio information of the user wearing the wearable device 200 may be thesame kind of bio information. For example, if the bio information of theuser of the mobile terminal 100 includes a pulse value of the user ofthe mobile terminal 100, the bio information of the user wearing thewearable device 200 may also include a pulse value of the user wearingthe wearable device 200. Also, if the bio information of the user of themobile terminal 100 is an ECG value of the user of the mobile terminal100, the bio information of the user wearing the wearable device 200 maybe also an ECG value of the user wearing the wearable device 200.

Also, that the bio signal of the user of the mobile terminal 100 and thebio signal of the user wearing the wearable device 200 are the same doesnot mean that they are physically the same as each other, but denotesthat the bio information of the user of the mobile terminal 100coincides with the bio information of the user wearing the wearabledevice 200 within a predetermined range.

For example, if the bio information of the user of the mobile terminal100 is measured as a first value and the bio information of the userwearing the wearable device 200 is within a range of the first value±apreset error value, the mobile terminal 100 may determine that the bioinformation of the user of the mobile terminal 100 is the same as thebio information of the user wearing the wearable device 200.

Here, if the bio information of the user of the mobile terminal 100 isthe same as the bio information of the user wearing the wearable device200, the mobile terminal 100 determines that one user holds the mobileterminal 100 in his/her hand while wearing the wearable device 200 onhis/her wrist, as shown in FIG. 28.

If it is determined that the bio information of the user of the mobileterminal 100 is the same as the bio information of the user wearing thewearable device 200, the mobile terminal 100 may perform an operationthat is set in advance in the mobile terminal 100, in operation S2780.Here, the set operation may be related to an operation that the wearabledevice 200 performs.

For example, the mobile terminal 100 may perform the operationsdescribed above with reference to FIGS. 10 to 26. If the lock mode ofthe wearable device 200 is unlocked, the mobile terminal 100 may unlockthe lock mode of the mobile terminal 100. Otherwise, if the wearabledevice 200 performs the user authentication, the mobile terminal 100 mayalso performs the user authentication. Otherwise, if the wearable device200 displays a web page, the mobile terminal 100 may display a web pagethat is the same as the web page that is currently being displayed onthe wearable device 200. Otherwise, if the wearable device 200 receivesa call connection request, the mobile terminal 100 may perform the callconnection. Otherwise, if the user is calling via the wearable device200, the user may continuously perform the call via the mobile terminal100. Otherwise, if the wearable device 200 is reproducing a piece ofcontent, the mobile terminal 100 may continuously reproduce the contentthat has been reproduced by the wearable device 200.

FIG. 29 is a flowchart illustrating a method of performing an operationset in advance in the mobile terminal 100, when a touch pattern sensedby the mobile terminal 100 is the same as a pattern captured by thewearable device 200, according to an exemplary embodiment, and FIG. 30is a diagram illustrating the method of FIG. 29.

Referring to FIG. 29, the wearable device 200 may transmitidentification information to the mobile terminal 100 that is in adistance range set in advance, in operation S2910.

The mobile terminal 100 may recognize the wearable device 200 that iswithin a distance range set in advance from the mobile terminal 100, inoperation S2920.

Also, the mobile terminal 100 may determine whether the recognizedwearable device 200 is connected to the mobile terminal 100, inoperation S2930.

Operations S2910 to S2930 of FIG. 29 correspond to operations S420 toS440 of FIG. 4, and thus, detailed descriptions thereof are omittedhere.

If the recognized wearable device 200 is connected to the mobileterminal 100, the mobile terminal 100 may acquire touch patterninformation by sensing a touch pattern input by the user, in operationS2940.

The mobile terminal 100 may include a touch screen module, and may sensethe input touch pattern (hereinafter, referred to as a first pattern) bysensing a touch gesture on the touch screen. Here, the mobile terminal100 may include various sensors in the touch screen or near the touchscreen to sense the touch input or proximate touch on the touch screen.

As shown in FIG. 30, the user may input the touch pattern (firstpattern) on the display formed of the touch screen in the mobileterminal 100 by using a finger or a touch tool.

For example, if the user inputs a star pattern on the display of themobile terminal 100, the mobile terminal 100 may acquire touch patterninformation (first pattern information) including information about ashape or a size of the touch pattern input by the user (for example,information indicating that the touch pattern input by the user is thestar pattern).

Referring again to FIG. 29, if the user of the mobile terminal 100inputs the touch pattern into the mobile terminal 100 in a state ofwearing the wearable device 200 that includes a camera, the wearabledevice 200 may capture or photograph a touch gesture of the user of themobile terminal 100 and the touch pattern (first pattern) displayed onthe mobile terminal 100, in operation S2945.

For example, referring to FIG. 30, the wearable device 200 may be a headmounted display (HMD), but is not limited thereto. In addition, the HMDmay include glasses, a helmet, or a hat, but is not limited thereto.

Also, the wearable device 200 includes the camera on a front portionthereof to capture the touch gesture of the user of the mobile terminal100 and the touch pattern displayed on the mobile terminal 100, if theuser sees the mobile terminal 100 while wearing the wearable device 200.

For example, the wearable device 200 may acquire captured patterninformation (second pattern information) including information about ashape or a size of the pattern captured by the wearable device 200 (forexample, information indicating that the pattern captured by thewearable device 200 is a star pattern).

The mobile terminal 100 may request the wearable device 200 for thecaptured or photographed pattern information (second patterninformation), in operation S2950.

The wearable device 200 may transmit the captured or photographedpattern information (second pattern information) to the mobile terminal100, in operation S2960. For example, the wearable device 200 maytransmit the captured pattern information to the mobile terminal 100 viashort-range communication. Here, short-range communication may includethe Wi-Fi method, NFC, Bluetooth method, the infrared ray method, orZigBee method, but is not limited thereto.

The mobile terminal 100 compares the first pattern information acquiredby the mobile terminal 100 and the second pattern information acquiredby the wearable device 200 with each other to determine whether thetouch pattern (first pattern) of the mobile terminal 200 is the same asthe captured or photographed pattern (second pattern) of the wearabledevice 200, in operation S2970.

That the touch pattern (first pattern) of the mobile terminal 100 is thesame as the captured pattern (second pattern) of the wearable device 200does not mean that they are literally the same as each other, butdenotes that the touch pattern (first pattern) of the mobile terminal100 coincides with the captured pattern (second pattern) of the wearabledevice 200 within a predetermined range.

Here, if the first pattern is the same as the second pattern, as shownin FIG. 30, the mobile terminal 100 may determine that one user holdsthe mobile terminal 100 in his/her hand while wearing the wearabledevice 200 connected to the mobile terminal 100 on his/her head.

When it is determined that the first pattern is the same as the secondpattern, the mobile terminal 100 may perform an operation that is set inadvance in the mobile terminal 100, in operation S2980.

Because operation S2980 of FIG. 29 corresponds to operation S2780 ofFIG. 27, detailed descriptions thereof are omitted.

FIG. 31 is a flowchart illustrating a method of performing an operationset in advance in the mobile terminal 100, when a user image captured bythe mobile terminal 100 is the same as a user image captured by thewearable device 200, according to an exemplary embodiment, and FIG. 32is a diagram illustrating the method of FIG. 31.

Referring to FIG. 31, the wearable device 200 may transmitidentification information to the mobile terminal 100 that is within adistance range set in advance, in operation S3110.

The mobile terminal 100 may recognize the wearable device 200 that iswithin a distance range set in advance from the mobile terminal 100, inoperation S3120.

Also, the mobile terminal 100 may determine whether the recognizedwearable device 200 is connected to the mobile terminal, in operationS3130.

Operations S3110 to S3130 of FIG. 31 correspond to operation S420 toS440 of FIG. 4, and thus, detailed descriptions thereof are omittedhere.

If the recognized wearable device 200 is connected to the mobileterminal 100, the mobile terminal 100 may photograph the face of theuser of the mobile terminal 100 to obtain a user image (first image), inoperation S3140.

For example, the mobile terminal 100 may include a camera forphotographing the face of the user of the mobile terminal 100, and thecamera is disposed on a front surface portion of the mobile terminal 100as shown in FIG. 32 to easily photograph the face of the user holdingthe mobile terminal 100.

Referring again to FIG. 31, the wearable device 200 connected to themobile terminal 100 may photograph the face of the user wearing thewearable device 200 by using a camera to obtain a user image (secondimage), in operation S3145.

Here, the wearable device 200 may photograph the user of the wearabledevice at the same time with the mobile terminal 100 photographing theuser of the mobile terminal 100 (operation S3140).

In addition, the mobile terminal 100 may request the wearable device 200for the captured user image of the wearable device 200, in operationS3150.

The wearable device 200 may transmit the captured user image (secondimage) to the mobile terminal 100, in operation S3160. For example, thewearable device 200 may transmit the second image to the mobile terminal100 via short-range communication. Here, short-range communication mayinclude the Wi-Fi method, NFC, Bluetooth method, the infrared raymethod, or ZigBee method, but is not limited thereto.

The mobile terminal 100 compares the user image (first image)photographed by the mobile terminal 100 with the second imagetransmitted from the wearable device 200 to determine whether the userof the mobile terminal 100 is the same as the user of the wearabledevice 200, in operation S3170.

The mobile terminal 100 may determine whether the face of the userincluded in the first image and the face of the user included in thesecond image are the face of one person. For example, the mobileterminal 100 may determine whether the face included in the first imageand the face included in the second image are the same face by analyzingsymmetrical configuration of the user's face included in the first andsecond images, distances between eyes, nose, and mouth that are mainparts in the face and shapes thereof, and color(s) of the eyes.

If it is determined that the user of the mobile terminal 100 is the sameas the user of the wearable device 200, as shown in FIG. 32, the mobileterminal 100 may determine that one user holds the mobile terminal 100while wearing the wearable device 200 connected to the mobile terminal100.

For example, as shown in FIG. 32, if the wearable device 200 is a watchthat the user may wear on his/her wrist and the user holding the mobileterminal 100 on his/her hand wears the wearable device 200 on his/herwrist, the mobile terminal 100 and the wearable device 200 mayphotograph the same person.

If it is determined that the user of the mobile terminal 100 is the sameas the user of the wearable device 200, the mobile terminal 100 mayperform an operation that is set in advance in the mobile terminal 100,in operation S3180.

Because operation S3180 of FIG. 31 corresponds to operation S2780 ofFIG. 27, detailed descriptions thereof are omitted.

FIG. 33 is a flowchart illustrating a method of operating the mobileterminal 100, according to an exemplary embodiment.

Referring to FIG. 33, the mobile terminal 100 according to the exemplaryembodiment may operate in a common mode, in operation S3310. Forexample, the common mode may be a mode, in which only some applicationsthat are set in advance are shown on the home screen and execution ofsome other applications (for example, a gallery application, a phonebook application, or a message application) is restricted.

Also, the common mode may be a mode, in which only some of functions maybe performed when executing an application or only some content isdisplayed, and will be described in more detail later with reference toFIGS. 38 to 41.

The mobile terminal 100 may determine whether the wearable device 200connected to the mobile terminal 100 is worn by the same user of themobile terminal 100, in operation S3320.

As a result of determination, if the user of the mobile terminal 100wears the wearable device 200 connected to the wearable device 200, themobile terminal 100 may switch the operation mode of the mobile terminal100 from the common mode to a personal mode, in operation S3330.

For example, in the personal mode, applications that have not beendisplayed in the common mode may be displayed on the home screen, andsome of the applications, which are restricted to be executed in thecommon mode, may be executed.

Also, when executing applications, some functions that have beenrestricted in the common mode may be executed, and some content that isrestricted to be displayed in the common mode may be displayed in thepersonal mode. This will be described in more detail later withreference to FIGS. 38 to 41.

FIGS. 34 to 37 are flowcharts illustrating methods of switching thecommon mode to the personal mode, based on whether the user of themobile terminal 100 wears the wearable device 200 connected to themobile terminal 100, according to exemplary embodiments.

FIG. 34 is a flowchart illustrating a method of switching the operatingstate of the mobile terminal 100 from the common mode to the personalmode, when a motion sensed by the mobile terminal 100 is the same as themotion sensed by the wearable device 200.

Referring to FIG. 34, the mobile terminal 100 may be in the common modein operation S3410. As described above with reference to FIG. 33, in thecommon mode, some applications that are set in advance are onlydisplayed on the home screen, and some applications (e.g., a galleryapplication, a phone book application, and a message application) arerestricted to be executed. Also, when executing an application, onlysome of the functions may be performed or only some content isdisplayed.

In addition, the wearable device 200 may transmit identificationinformation to the mobile terminal 100 that is in a distance range setin advance, in operation S3420.

For example, if the mobile terminal 100 and the wearable device 200 arein within the distance range set in advance from each other, the mobileterminal 100 and the wearable device 200 may transmit/receive useridentification information or device identification information to/fromeach other via short-range communication.

Accordingly, the mobile terminal 100 may recognize the wearable device200 that is within the distance range set in advance from the mobileterminal 100, in operation S3430.

The mobile terminal 100 may determine whether the recognized wearabledevice 200 is connected to the mobile terminal 100, in operation S3440.

For example, the mobile terminal 100 may compare the identificationinformation transmitted from the wearable device 200 with theidentification information of the wearable device registered in themobile terminal 100 to determine whether the recognized wearable device200 is connected to the mobile terminal 100.

If the recognized wearable device 200 is connected to the mobileterminal 100, the mobile terminal 100 may acquire motion information bysensing the motion thereof, in operation S3450.

For example, the mobile terminal 100 may measure a direction, avelocity, and a variation in the velocity of a movement of the mobileterminal 100 by using a geomagnetic sensor, a location sensor, anacceleration sensor, a proximity sensor, or a gyroscope sensor.

In addition, the wearable device 200 may acquire motion information bysensing the motion thereof in operation S3455. Here, the wearable device200 may acquire the motion information of the wearable device 200 bysensing the motion of the wearable device 200 at the same time when themobile terminal 100 senses the motion thereof (operation S3450).

For example, the wearable device 200 may measure a direction, avelocity, and a variation in the velocity of a movement of the wearabledevice 200 by using a geomagnetic sensor, a location sensor, anacceleration sensor, a proximity sensor, or a gyroscope sensor.

In addition, the mobile terminal 100 may request the wearable device 200for the motion information of the wearable device 200, in operationS3460.

The wearable device 200 may transmit the motion information of thewearable device 200, sensed by the wearable device 200, to the mobileterminal 100, in operation S3470.

The mobile terminal 100 compares the motion information of the mobileterminal 100 with the motion information of the wearable device 200 todetermine whether the motion of the mobile terminal 100 is the same asor similar to the motion of the wearable device 200, in operation S3480.

Here, that the motion of the mobile terminal 100 is the same as themotion of the wearable device 200 does not denote that the physicalmotions are completely the same as each other, but denotes that themotion information of the mobile terminal 100 (e.g., the movingdirection, moving amount, and velocity of the mobile terminal 100)coincides with the motion information of the wearable device 200 (e.g.,the moving direction, moving amount, and velocity of the wearable device200) within a predetermined range.

If it is determined that the motion of the mobile terminal 100 is thesame as or similar to the motion of the wearable device 200, the mobileterminal 100 may determine that the user of the mobile terminal 100 andthe user wearing the wearable device 200 are the same person, and mayswitch the operating state of the mobile terminal 100 from the commonmode to the personal mode, in operation S3490.

As described above with reference to FIG. 33, in the personal mode,applications that have not been displayed in the common mode may bedisplayed on the home screen, and some applications that have beenrestricted to be executed in the common mode may be executed. Also, whenexecuting an application, a function that has been restricted in thecommon mode may be performed, and the content that has not beendisplayed in the common mode may be displayed in the personal mode.

FIG. 35 is a flowchart illustrating a method of switching the operatingstate of the mobile terminal 100 from the common mode to the personalmode, when a bio signal sensed by the mobile terminal 100 is the same asa bio signal sensed by the wearable device 200.

Referring to FIG. 35, the mobile terminal 100 may be in the common mode,in operation S3510.

Referring to FIG. 35, the wearable device 200 may transmitidentification information to the mobile terminal 100 that is within adistance range set in advance, in operation S3520.

The mobile terminal 100 may recognize the wearable device 200 that iswithin a distance range set in advance from the mobile terminal 100, inoperation S3530.

The mobile terminal 100 may determine whether the recognized wearabledevice 200 is connected to the mobile terminal 100, in operation S3540.

Because operations S3510 to S3540 of FIG. 35 correspond to operationsS3410 to S3440 of FIG. 34, detailed descriptions thereof are omitted.

If the recognized wearable device 200 is connected to the mobileterminal 100, the mobile terminal 100 senses a bio signal of the user ofthe mobile terminal 100 to acquire bio information, in operation S3550.

For example, the mobile terminal 100 may include a bio signal sensor forsensing the bio signal of the user of the mobile terminal 100. Here, thebio signal sensor is included in a portion contacting the hand of theuser when the user is holding the mobile terminal 100 in his/her hand,so that the bio signal may be automatically sensed.

Accordingly, the mobile terminal 100 may measure a temperature, a pulse,an electrocardiogram (ECG), a heart rate, or a blood pressure of theuser by using the bio signal sensor.

Also, the wearable device 200 connected to the mobile terminal 100 mayacquire bio information by sensing a bio signal of the user wearing thewearable device 200, in operation S3555.

For example, the wearable device 200 may include a bio signal sensor forsensing the bio signal of the user. Here, the bio signal sensor isincluded in a portion contacting the body of the user when the userwears the wearable device 200, and thus, the bio signal may beautomatically sensed when the user wears the wearable device 200.

Accordingly, the wearable device 200 may measure a temperature, a pulse,an ECG, a heart rate, or a blood pressure of the user by using the biosignal sensor.

In addition, the mobile terminal 100 may request the wearable device 200for the bio information of the user wearing the wearable device 200, inoperation S3560.

The wearable device 200 may transmit the bio information of the userwearing the wearable device 200 to the mobile terminal 100, in operationS3570.

The mobile terminal 100 may compare the bio information of the user ofthe mobile terminal 100 with the bio information of the user wearing thewearable device 200 to determine whether the bio signal of the user ofthe mobile terminal 100 is the same as the bio signal of the userwearing the wearable device 200, in operation S3580.

Here, the bio information of the user of the mobile terminal 100 and thebio information of the user wearing the wearable device 200 may be thebio information of the same kind. For example, if the bio information ofthe user of the mobile terminal 100 is a value measuring the pulse ofthe user of the mobile terminal 100, the bio information of the userwearing the wearable device 200 may be also a value of measuring thepulse of the user wearing the wearable device 200. Also, if the bioinformation of the user of the mobile terminal 100 is a value measuringthe ECG of the user of the mobile terminal 100, the bio information ofthe user wearing the wearable device 200 may be also a value ofmeasuring the ECG of the user wearing the wearable device 200.

Also, that the bio signal of the user of the mobile terminal 100 is thesame as the bio signal of the user wearing the wearable device 200 doesnot denote that the bio signals are physically the same as each other,but denotes that the bio information of the user of the mobile terminal100 coincides with the bio information of the user wearing the wearabledevice 200 within a predetermined range.

For example, if the bio information of the user of the mobile terminal100 is measured as a first value and the bio information of the userwearing the wearable device 200 is within a range of the first value±apredetermined error value, the mobile terminal 100 may determine thatthe bio information of the user of the mobile terminal 100 is the sameas the bio information of the user wearing the wearable device 200.

When it is determined that the bio signal of the user of the mobileterminal 100 is the same as the bio signal of the user wearing thewearable device 200, the mobile terminal 100 may determine that the userof the mobile terminal 100 and the user wearing the wearable device 200are the same person, and may switch the operating mode of the mobileterminal 100 from the common mode to the personal mode, in operationS3590.

Because operation S3590 of FIG. 35 corresponds to operation S3490 ofFIG. 34, detailed descriptions thereof are omitted.

FIG. 36 is a flowchart illustrating a method of switching the operatingstate of the mobile terminal 100 from the common mode to the personalmode, when a touch pattern sensed by the mobile terminal 100 and apattern photographed by the wearable device 200 are identical.

Referring to FIG. 36, the mobile terminal 100 may be in the common mode,in operation S3610.

Referring to FIG. 36, the wearable device 200 may transmitidentification information to the mobile terminal 100 that is in adistance range set in advance, in operation S3620.

The mobile terminal 100 may recognize the wearable device 200 that iswithin a distance range set in advance from the mobile terminal 100, inoperation S3630.

The mobile terminal 100 may determine whether the recognized wearabledevice 200 is connected to the mobile terminal 100, in operation S3640.

Because operations S3610 to S3640 of FIG. 36 correspond to operationsS3410 to S3440 of FIG. 34, detailed descriptions thereof are omitted.

If the recognized wearable device 200 is connected to the mobileterminal 100, the mobile terminal 100 senses a touch pattern input bythe user to acquire touch pattern information, in operation S3650.

The mobile terminal 100 may include a touch screen module and may sensea touch pattern (hereinafter, referred to as a first pattern) by sensinga touch gesture on the touch screen. Here, the mobile terminal 100 mayinclude various sensors in the touch screen or around the touch screento sense the touch input into the touch screen or a proximate touch.

Also, the user may input the touch pattern (first pattern) into thedisplay including the touch screen of the mobile terminal 100 by using afinger or a touch tool.

For example, if the user inputs a star shape into the display of themobile terminal 100, the mobile terminal 100 may acquire touch patterninformation (first pattern information) including information about ashape or a size of the touch pattern input by the user (for example,information indicating that the touch pattern input by the user isformed as a star).

Also, if the user of the mobile terminal 100 inputs the touch patterninto the mobile terminal 100 while wearing the wearable device 200including a camera, the wearable device 200 may photograph the touchgesture of the user of the mobile terminal 100 and the touch pattern(first pattern) displayed on the display of the mobile terminal 100, inoperation S3655.

For example, the wearable device 200 may be an HMD that the user maywear on his/her head, but is not limited thereto. Also, the HMD mayinclude glasses, a hat, or a helmet, but is not limited thereto.

In addition, the wearable device 200 may include the camera on a frontportion thereof to be configured to photograph the touch gesture of theuser of the mobile terminal 100 and the touch pattern displayed on themobile terminal 100, when the user views the mobile terminal 100 whilewearing the wearable device 200.

For example, the wearable device 200 may acquire photographed patterninformation (second pattern information) including information about ashape or a size of the pattern photographed by the wearable device 200(e.g., information indicating that the pattern photographed by thewearable device 200 is formed as a star).

In addition, the mobile terminal 100 may request the wearable device 200for the photographed pattern information (second pattern information) inoperation S3660.

The wearable device 200 may transmit the photographed patterninformation (second pattern information) to the mobile terminal 100, inoperation S3670.

The mobile terminal 100 may compare the first pattern informationacquired by the mobile terminal 100 with the second pattern informationtransmitted from the wearable device 200 to determine whether the touchpattern (first pattern) of the mobile terminal 100 is the same as thephotographed pattern (second pattern) of the wearable device 200, inoperation S3680.

That the touch pattern (first pattern) of the mobile terminal 100 andthe photographed pattern (second pattern) of the wearable device 200 areidentical with each other does not denote that the first and secondpatterns are physically identical with each other, but denotes that thetouch pattern (first pattern) of the mobile terminal 100 coincides withthe photographed pattern (second pattern) of the wearable device 200within a predetermined range.

If it is determined that the first pattern is the same as the secondpattern, the mobile terminal 100 may determine that the user of themobile terminal 100 and the user wearing the wearable device 200 are thesame person, and may switch the operating state of the mobile terminal100 from the common mode to the personal mode, in operation S3690.

Operation S3690 of FIG. 36 corresponds to operation S3490 of FIG. 34,and thus, detailed descriptions thereof are omitted.

FIG. 37 is a flowchart illustrating a method of switching the operatingstate of the mobile terminal 100 from the common mode to the personalmode, when a user image captured by the mobile terminal 100 is the sameas a user image captured by the wearable device 200, according to theexemplary embodiment.

Referring to FIG. 37, the mobile terminal 100 may be in the common mode,in operation S3710.

In addition, the wearable device 200 may transmit identificationinformation to the mobile terminal 100 that is within a distance rangeset in advance, in operation S3720.

The mobile terminal 100 may recognize the wearable device 200 that iswithin a distance range set in advance from the mobile terminal 100, inoperation S3730.

The mobile terminal 100 may determine whether the recognized wearabledevice 200 is connected to the mobile terminal 100, in operation S3740.

Because operations S3710 to S3740 of FIG. 37 correspond to operationsS3410 to S3440 of FIG. 34, detailed descriptions thereof are omitted.

If the recognized wearable device 200 is connected to the mobileterminal 100, the wearable device 200 photographs a face of the user ofthe mobile terminal 100 to obtain a user image (first image), inoperation S3750.

For example, the mobile terminal 100 may include a camera that mayphotograph the face of the user of the mobile terminal 100, and thecamera is disposed on a front portion of the mobile terminal 100 toeasily photograph the face of the user who is holding the mobileterminal 100.

The wearable device 200 connected to the mobile terminal 100 mayphotograph the face of the user wearing the wearable device 200 by usinga camera to obtain a user image (second image), in operation S3755.

In addition, the mobile terminal 100 may request the wearable device 200for the captured user image of the wearable device 200, in operationS3760.

The wearable device 200 may transmit the captured user image of the userwearing the wearable device 200 to the mobile terminal 100, in operationS3770.

The mobile terminal 100 may compare the user image (first image)captured by the mobile terminal 100 with the second image transmittedfrom the wearable device 200 to determine whether the user of the mobileterminal 100 is the same as the user of the wearable device 200, inoperation S3780.

The mobile terminal 100 may determine whether the face of the userincluded in the first image and the face of the user included in thesecond image are the face of the same person. For example, the mobileterminal 100 may determine whether the face included in the first imageis the same as the face included in the second image by analyzing asymmetrical configuration of the faces, distances and shapes of theeyes, the nose, and the mouth that are the main parts of the face, andcolor(s) of the eyes in the faces of the first image and the secondimage.

If it is determined that the user of the mobile terminal 100 is the sameas the user of the wearable device 200, the mobile terminal 100 maydetermine that the user of the mobile terminal 100 and the user wearingthe wearable device 200 are the same person, and may switch theoperating state of the mobile terminal 100 from the common mode to thepersonal mode, in operation S3790.

Operation S3790 of FIG. 37 corresponds to operation S3490 of FIG. 34,and thus, detailed descriptions thereof are omitted.

FIG. 38 is a diagram of a common mode and a personal mode of the mobileterminal 100, according to an exemplary embodiment.

Referring to portion (a) of FIG. 38, in the common mode of the mobileterminal 100 according to the exemplary embodiment, menus of someapplications may not be displayed.

Here, some applications that are not displayed in the common mode mayinclude applications including personal information of the user of themobile terminal 100 (e.g., a message application, a gallery application,and a phone book application), or applications set in advance by theuser.

In addition, if it is determined that the user of the mobile terminal100 and the user wearing the wearable device 200 are the same person,the mobile terminal 100 may switch the operating mode of the mobileterminal 100 from the common mode to the personal mode.

For example, cases where it is determined that the user of the mobileterminal 100 and the user of the wearable device 200 are the same personmay include a case where the motion of the mobile terminal 100 is thesame as the motion of the wearable device 200, a case where the biosignal of the user of the mobile terminal 100 is the same as the biosignal of the user wearing the wearable device 200, a case where thetouch pattern of the mobile terminal 100 and the pattern photographed bythe wearable device 200 are identical with each other, and a case wherethe user image of the mobile terminal 100 is the same as the user imageof the wearable device 200, but are not limited thereto.

In addition, in the personal mode of the mobile terminal 100 accordingto the exemplary embodiment, menus of the applications that have notbeen displayed in the common mode may be displayed as shown in portion(b) of FIG. 38.

Also, if the menu of the application that is not displayed in the commonmode is selected, the mobile terminal 100 may execute the selectedapplication based on a user input.

Accordingly, the mobile terminal 100 may display and execute some of theapplications (e.g., the applications including the personal informationof the user of the mobile terminal 100) only when the user of the mobileterminal 100 is wearing the wearable device 200 that is connected to themobile terminal 100, and thus, privacy of the user of the mobileterminal 100 may be protected.

FIG. 39 is a diagram of a method of operating the mobile terminal 100 ina common mode, and FIG. 40 is a diagram of a method of operating themobile terminal 100 in a personal mode, according to an exemplaryembodiment.

Referring to portion (a) of FIG. 39, the menus of the applicationinstalled on the mobile terminal 100 may be displayed in the common modeof the mobile terminal 100 according to the exemplary embodiment.

Here, if the user of the mobile terminal 100 selects some of the menusof the applications displayed on the display of the mobile terminal 100,the execution of the selected applications may be restricted.

The some applications, execution of which is restricted, may includeapplications including the personal information of the user of themobile terminal 100 (e.g., the message application, the galleryapplication, and the phone book application), or other applications setin advance by the user.

Also, if the user selects the some applications that are restricted tobe executed, the mobile terminal 100 may display a message notifyingthat the selected application may not be executed. For example, if theuser of the mobile terminal 100 selects the gallery application as shownin portion (a) of FIG. 39, the mobile terminal 100 may display a message3920 notifying that the gallery application may not be executed as shownin portion (b) of FIG. 39.

In addition, if it is determined that the user of the mobile terminal100 and the user wearing the wearable device 200 are the same person,the mobile terminal 100 may switch the operating mode thereof to thepersonal mode.

Referring to portion (a) of FIG. 40, in the personal mode of the mobileterminal 100, menus of the applications installed on the mobile terminal100 may be displayed.

Here, if the user of the mobile terminal 100 selects an application thatis restricted to be executed in the common mode from among the menus ofthe applications displayed on the display (e.g., the applicationincluding the personal information of the user of the mobile terminal100), the mobile terminal 100 may execute the selected application.

For example, if the user of the mobile terminal 100 selects the galleryapplication as shown in portion (a) of FIG. 40, the mobile terminal 100may display an execution screen 4020 of the gallery application as shownin portion (b) of FIG. 40.

Accordingly, the mobile terminal 100 may execute some applications(e.g., applications including personal information of the user of themobile terminal 100) only when the user of the mobile terminal 100 wearsthe wearable device 200 connected to the mobile terminal 100, and thus,the privacy of the user of the mobile terminal 100 may be protected.

FIG. 41 is a diagram of a common mode and a personal mode of the mobileterminal 100, according to an exemplary embodiment.

Referring to FIGS. 41A and 41B, some functions of an application may berestricted in the common mode of the mobile terminal 100 according tothe exemplary embodiment.

For example, as shown in portion (a) of FIG. 41, if the galleryapplication is executed in the common mode of the mobile terminal 100,some images included in the gallery application may not be displayed.Here, the some images that are not displayed in the common mode may beset in advance by the user.

In addition, if it is determined that the user of the mobile terminal100 and the user wearing the wearable device 200 are the same person,the mobile terminal 100 may switch the operating mode of the mobileterminal 100 into the personal mode.

In the personal mode of the mobile terminal 100 according to theexemplary embodiment, when the gallery application is executed as shownin portion (b) of FIG. 41, an image 4120 that is not displayed in thecommon mode may be displayed.

Accordingly, the mobile terminal 100 according to the exemplaryembodiment may execute some functions of the application (e.g.,restricted image display) only when the user of the mobile terminal 100wears the wearable device 200 connected to the mobile terminal 100, andthus, protects the privacy of the user of the mobile terminal 100.

FIGS. 42 and 43 are block diagrams of the mobile terminal 100, accordingto exemplary embodiments.

Referring to FIG. 42, the mobile terminal 100 includes a communicationinterface 110, a controller 130, and a sensor 150. However, not all ofthe elements shown in FIG. 42 are essential elements, that is, themobile terminal 100 may include more or less elements than those of FIG.42.

For example, referring to FIG. 43, the mobile terminal 100 may furtherinclude an output module 120, a user interface 140, an audio/video (A/V)input module 160, and a memory 170, in addition to the communicationinterface 110, the controller 130, and the sensor 150.

The above elements will be described below.

The communication interface 110 may include one or more elements forperforming communication between the mobile terminal 100 and thewearable device 200 or an external device. For example, thecommunication interface 110 may include a short-range communicationinterface 111, a mobile communication interface 112, and a broadcastreceiver 113.

The short-range wireless communication interface 111 may include, but isnot limited to, a Bluetooth communication interface, BLE communicationinterface, a Near Field Communication (NFC) interface, a WLAN (Wi-Fi)communication interface, a ZigBee communication interface, an IrDAcommunication interface, a Wi-Fi direct (WFD) communication interface,an ultra wideband (UWB) communication interface, or an Ant+communication interface.

The mobile communication interface 112 exchanges a wireless signal withat least one selected from a base station, an external terminal, and aserver on a mobile communication network. The wireless signal mayinclude various types of data according to transmission of a sound callsignal, a video call signal, or a text/multimedia message.

The broadcast receiver 113 receives a broadcast signal and/orinformation related to a broadcast from the outside through a broadcastchannel. The broadcast channel may include a satellite channel and aground wave channel. In another embodiment, the mobile terminal 100 maynot include the broadcast receiver 113.

The communication interface 110 may transmit and receive data to/fromthe wearable device 200. Also, the communication interface 110 mayreceive the user authentication information or the device identificationinformation of the wearable device 200 from the wearable device 200, andmay transmit the user authentication information or the deviceidentification information of the mobile terminal 100 to the wearabledevice 200.

Also, the communication interface 110 may receive the motion informationof the wearable device 200, the bio information of the user wearing thewearable device 200, the pattern information captured by the wearabledevice 200, or the user image of the wearable device 200 from thewearable device 200 connected to the mobile terminal 100.

The output module 120 outputs an audio signal, a video signal, or avibration signal, and may include a display 121, a speaker 122, and avibration motor 123.

The display 121 displays and outputs the information processed by themobile terminal 100. For example, if the wearable device 200 connectedto the mobile terminal 100 exists within the preset distance range, thedisplay 121 may display a motion unlock function notification message,and may display the home screen when the lock mode of the mobileterminal 100 is unlocked.

Also, the display 121 may display the web page or content that iscurrently being displayed on the wearable device 200, and may displaythe message transmitted from the wearable device 200.

In addition, if the display 121 and a touch pad form a mutual layerstructure and then are formed as a touch screen, the display 121 may beused as both an output device and input device. The display 121 mayinclude at least one of a liquid crystal display (LCD), a thin filmtransistor-liquid crystal display (TFT-LCD), an organic light-emittingdiode (OLED) display, a flexible display, a 3D display, and anelectrophoretic display. Also, according to a type of the mobileterminal 100, the mobile terminal 100 may include at least two displays121.

The speaker 122 may output audio data that is received from thecommunication interface 110 or is stored in the memory 170. The speaker122 may also output a sound signal (e.g., a call signal receiving sound,a message receiving sound, a notifying sound, or the like) related tocapabilities performed by the mobile terminal 100. The speaker 122 mayinclude a buzzer or the like.

The vibration motor 123 may output a vibration signal. For example, thevibration motor 123 may output the vibration signal that corresponds toan output of the audio data (e.g., the call signal receiving sound, themessage receiving sound, or the like) or video data. Also, when a touchis input to the touch screen, the vibration motor 123 may output avibration signal.

The controller 130 may control all operations of the mobile terminal100. That is, the controller 130 may control the communication interface110, the output module 120, the user interface 140, the sensor 150, andthe A/V input module 160 by executing programs stored in the memory 170.

The controller 130 compares the motion information of the mobileterminal 100 with the motion information of the wearable device 200, andthen, if the motion of the mobile terminal 100 is the same as the motionof the wearable device 200, the controller 130 may unlock the lock modeof the mobile terminal 100.

The controller 130 may determine whether the wearable device 200 isconnected to the mobile terminal 100. The controller 130 may compare themotion of the mobile terminal 100 with a predetermined motion, and ifthe motion of the mobile terminal 100 is the same as the predeterminedmotion, the controller 130 may control the communication interface 110to receive the motion information of the wearable device 200.

If the motion of the mobile terminal 100 is the same as the wearabledevice 200, the controller 130 may control the mobile terminal 100 toperform an operation related to the operation currently performed by thewearable device 200.

If the wearable device 100 is reproducing a piece of content and themotion of the mobile terminal 100 is the same as the motion of thewearable device 200, the controller 130 may control the mobile terminal100 to reproduce the content reproduced by the wearable device 200continuously.

If the wearable device 200 displays a web page and the motion of themobile terminal 100 is the same as the motion of the wearable device200, the controller 130 may control the mobile terminal 100 to display aweb page that is the same as that displayed on the wearable device 200.

If the wearable device 200 receives a call connection request and themotion of the mobile terminal 100 is the same as the motion of thewearable device 200, the controller 130 may control the mobile terminal100 to connect the call.

If the wearable device 200 receives a notification message and themotion of the mobile terminal 100 is the same as the motion of thewearable device 200, the controller 130 may control the mobile terminal100 to execute an application related to the notification message.

The user interface 140 may be a device by which a user inputs data tocontrol the mobile terminal 100. For example, the user interface 140 mayinclude a key pad, a dome switch, a touch pad (a touch capacitive-typetouch pad, a pressure resistive-type touch pad, an infraredbeam-sensing-type touch pad, a surface acoustic wave-type touch pad, anintegral strain gauge type touch pad, a piezoelectric effect-type touchpad, or the like), a jog wheel, and a jog switch, but one or moreembodiments are not limited thereto.

The sensor 150 senses the state of the mobile terminal 100 or the statearound the mobile terminal 100, and transmits the sensed information tothe controller 130.

The sensor 150 may include at least one selected from a magnetic sensor151, an acceleration sensor 152, a temperature/humidity sensor 153, aninfrared ray sensor 154, a gyroscope sensor 155, a location sensor 156(for example, a GPS), a pressure sensor 157, a proximity sensor 158, andan RGB (luminance) sensor 159, but is not limited thereto. Functions ofthe above sensors may be intuitively deduced by one of ordinary skill inthe art from their names, and thus, detailed descriptions about thefunctions of the above sensors are not provided here.

The sensor 150 may sense the motion of the mobile terminal 100, biosignals of the user of the mobile terminal 100, and a touch signal inputinto the mobile terminal 100.

The A/V input module 160 inputs an audio signal or a video signal, andmay include a camera 161 and a microphone 162. The camera 161 may obtainan image frame such as a still image or a moving picture via an imagesensor during a video call mode or an image-capturing mode. An imagethat is captured via the image sensor may be processed by the controller130 or a separate image processor (not shown).

The image frame that is processed by the camera 161 may be stored in thememory 170 or may be transmitted to an external source via thecommunication interface 110. According to a configuration of the mobileterminal 100, two or more cameras 161 may be arranged.

The microphone 162 receives an external sound signal as an input andprocesses the received sound signal into electrical voice data. Forexample, the microphone 162 may receive a sound signal from an externaldevice or a speaker. To remove noise that occurs while the sound signalis externally input, the microphone 162 may use various noise removingalgorithms.

The memory 170 may store a program for processing and controlling thecontroller 130, or may store a plurality of pieces of input/output data(e.g., an application, content, an address book, etc.).

The memory 170 may include a storage medium of at least one type offlash memory, hard disk, multimedia card memory, card memory such as anSD or XD card memory, Random Access Memory (RAM), Static Random AccessMemory (SRAM), Read-Only Memory (ROM), Electrically ErasableProgrammable Read-Only Memory (EEPROM), Programmable Read-Only Memory(PROM), magnetic memory, magnetic disc, and optical disc. Also, themobile terminal 100 may run web storage or a cloud server that performsa storage function of the memory 170 on the Internet.

The programs stored in the memory 170 may be classified into a pluralityof modules according to their functions, for example, into a UI module171, a touch screen module 172, an alarm module 173, etc.

The UI module 171 may provide a specialized UI or GUI in connection withthe mobile terminal 100 for each application. The touch screen module172 may detect a user's touch gesture on the touch screen and transmitinformation related to the touch gesture to the controller 130. Thetouch screen module 172 may determine and analyze a touch code. Thetouch screen module 172 may be configured as additional hardwareincluding a controller.

Various sensors may be arranged in or near the touch screen to detect atouch or a proximate touch on the touch sensor. An example of the sensorto detect the touch on the touch screen may include a tactile sensor.The tactile sensor detects a contact of an object at least assensitively as a person can detect. The tactile sensor may detectvarious types of information such as the roughness of a contact surface,the hardness of the contact object, the temperature of a contact point,or the like.

An example of the sensor to detect the touch on the touch screen mayinclude a proximity sensor.

The proximity sensor detects the existence of an object that approachesa predetermined detection surface or that exists nearby, by using aforce of an electro-magnetic field or an infrared ray, instead ofmechanical contact. Examples of the proximity sensor include atransmission-type photoelectric sensor, a direction reflection-typephotoelectric sensor, a mirror reflection-type photoelectric sensor, ahigh frequency oscillation-type proximity sensor, a capacity-typeproximity sensor, a magnetic proximity sensor, an infrared-typeproximity sensor, or the like. The touch gesture of the user may includea tap gesture, a touch & hold gesture, a double tap gesture, a draggesture, a panning gesture, a flick gesture, a drag & drop gesture, aswipe gesture, or the like.

The alarm module 173 may generate a signal for notifying the user aboutan occurrence of an event in the mobile terminal 100. Examples of theevent that may occur in the mobile terminal 100 include a call signalreceiving event, a message receiving event, a key signal input event, aschedule notifying event, or the like. The alarm module 173 may outputan alarm signal in the form of a video signal via the display 121, analarm signal in the form of an audio signal via the speaker 122, or analarm signal in the form of a vibration signal via the vibration motor123.

FIG. 44 is a block diagram of the wearable device 200, according to anexemplary embodiment.

As shown in FIG. 44, the wearable device 200 includes a communicationinterface 210, a controller 230, a sensor 250, a camera 260, and adisplay 270. However, not all of the elements are essential. That is,the wearable device 200 may include more or less elements than those ofFIG. 44.

Hereinafter, the above elements will be described as follows.

The communication interface 210 may include one or more elements forperforming communication between the wearable device 200 and the mobileterminal 100 or an external device. For example, the communicationinterface 210 may include a short-range communication interface, amobile communication interface, and a broadcast receiving interface. Theshort-range communication interface, the mobile communication interface,and the broadcast receiving interface correspond to short-rangecommunication interface 111, the mobile communication interface 112, andthe broadcast receiver 113 of FIG. 42, and detailed descriptions thereofare omitted.

The sensor 250 senses the state of the wearable device 200 or the statearound the wearable device 200, and transmits the sensed information tothe controller 230.

The sensor 250 may sense the motion of the wearable device 200 or thebio signal of the user wearing the wearable device 200.

Also, the sensor 250 may sense whether the wearable device 200 is wornby the user. For example, the sensor 250 may sense whether the userwears the wearable device 200 by using a pressure sensor or a groundsensor. This is described above with reference to FIG. 6, and thus,detailed descriptions thereof are omitted.

In addition, the sensor 250 may include at least one selected from amagnetic sensor, an acceleration sensor, a temperature/humidity sensor,an infrared ray sensor, a gyroscope sensor, a location sensor (forexample, a GPS), a pressure sensor, a proximity sensor, and an RGB(luminance) sensor, but is not limited thereto.

The camera 260 may photograph the touch pattern input into the mobileterminal 200 or to photograph the user wearing the wearable device 200.

The camera may obtain an image frame such as a still image or a videovia an image sensor in a video call mode or a photographing mode. Theimages captured by the image sensor may be processed by the controller230 or an additional image processor (not shown). The image frameprocessed by the camera may be stored in a memory or transmitted tooutside via the communication interface 210. According to configurationof the wearable device 200, two or more cameras may be provided.

The display 270 may display web pages and various pieces of content, andmay display menus of applications installed on the wearable device 200.

The controller 230 controls overall operations of the wearable device200. For example, the controller 230 may control the communicationinterface 210, the sensing unit 220, the camera 260, and the display270.

FIG. 45 is a diagram of an interaction between a smart door-lock 300 andthe wearable device 200, according to an exemplary embodiment.

The smart door-lock 300 according to the exemplary embodiment may be anexample of the mobile terminal 100 illustrated with reference to FIG.42, and may include the communication interface 110, the controller 130,and the sensor 150.

The wearable device 200 according to the exemplary embodiment may be inan unlock state. For example, the unlock state of the wearable device200 may be a state in which the home screen is displayed on the displayof the wearable device 200. Otherwise, menus of the applicationsinstalled on the wearable device 200 are displayed on the display of thewearable device 200, and when a menu of an application is selected, theselected application may be executed.

Also, the wearable device 200 may transmit identification information tothe smart door-lock that exists within a distance range set in advance.For example, when the smart door-lock 300 and the wearable device 200exist within the predetermined distance range, the smart door-lock 300and the wearable device 200 may transmit and receive user authenticationinformation or device identification information to/from each other viashort-range communication. Accordingly, the smart door-lock 300 mayrecognize the wearable device 200 that is within the distance range setin advance from the smart door-lock 300.

The smart door-lock 300 may determine whether the recognized wearabledevice 200 is connected thereto. For example, the smart door-lock 300compares the identification information transmitted from the wearabledevice 200 with the identification information of the wearable deviceregistered in the smart door-lock 300 to determine whether therecognized wearable device 200 is connected to the smart door-lock 300.

If the recognized wearable device 200 is connected to the smartdoor-lock 300, the smart door-lock 300 may request the wearable device200 for motion information of the wearable device 200. The wearabledevice 200 may measure a direction, a velocity, or a variation in thevelocity of a movement of the wearable device 200 by using the magneticsensor, the location sensor, the acceleration sensor, the proximitysensor, or the gyroscope sensor, in response to the request. Also, thewearable device 200 may transmit motion information of the wearabledevice 200, sensed by the wearable device 200, to the smart door-lock300.

The smart door-lock 300 may determine whether the motion of the wearabledevice 200 is a user's motion to rotate a handle of the smart door-lock300 (motion for rotating the smart door-lock to open), based on themotion information of the wearable device 200 transmitted from thewearable device 200. For example, the smart door-lock 300 may determinewhether the motion information of the wearable device 200 and the motioninformation stored in advance (e.g., information about the motion ofrotating the handle of the smart door-lock 300) have a correlation of apredetermined level or greater.

If the motion information of the wearable device 200 and the motioninformation stored in advance have the correlation of a predeterminedlevel or greater, the smart door-lock 300 may unlock the lock state ofthe smart door-lock 300.

FIG. 46 is a diagram of a method of displaying detailed information of anotification message 4610 on the mobile terminal 100, when a motion ofthe mobile terminal 100 is the same as a motion of the wearable device200, according to an exemplary embodiment.

Referring to FIG. 46, the mobile terminal 100 receives the notificationmessage 4610 in the lock mode, and when the motion of the mobileterminal 100 is the same as the motion of the wearable device 200, themobile terminal 100 may execute an application related to thenotification message 4610.

For example, the mobile terminal 100 may receive various notificationmessages such as a notification message regarding an SNS application, amessage notifying receipt of a message, or a notification messageregarding a game application in the lock mode, and display thenotification messages on the display thereof. Also, the notificationmessage may be displayed as a pop-up window.

If the motion information sensed by the wearable device 200 connected tothe mobile terminal 100 is the same as the motion information sensed bythe mobile terminal 100 at the same time with the wearable device 200,the mobile terminal 100 may unlock the lock mode of the mobile terminal100, and may execute the application related to the notification message4610.

For example, as shown in FIG. 46, if the notification message 4610 is amessage for notifying receipt of a message (e.g., a text message, aninstant message, a chatting message, or an e-mail), the mobile terminal100 may execute the application related to the message, and display areceived message 4620 on the display.

Accordingly, if the mobile terminal 100 receives the notificationmessage 4610 in the lock mode, there is no need to unlock the lock modeof the mobile terminal, to select and execute the applicationcorresponding to the notification message 4610. Instead, the detailedcontent related to the notification message 4610 may be identified onlyby performing a motion (e.g., holding and lifting the mobile terminal100).

In addition, the exemplary embodiments may also be implemented throughcomputer-readable code and/or instructions on a medium, e.g., anon-transitory computer-readable medium, to control at least oneprocessing element to implement any above-described embodiments. Themedium may correspond to any medium or media which may serve as astorage and/or perform transmission of the computer-readable code.

The computer-readable code may be recorded and/or transferred on amedium in a variety of ways, and examples of the medium includerecording media, such as magnetic storage media (e.g., ROM, floppydisks, hard disks, etc.) and optical recording media (e.g., compact discread only memories (CD-ROMs) or digital versatile discs (DVDs)), andtransmission media such as Internet transmission media. Thus, the mediummay have a structure suitable for storing or carrying a signal orinformation, such as a device carrying a bitstream according to one ormore exemplary embodiments. The medium may also be on a distributednetwork, so that the computer-readable code is stored and/or transferredon the medium and executed in a distributed fashion. Furthermore, theprocessing element may include a processor or a computer processor, andthe processing element may be distributed and/or included in a singledevice.

The foregoing exemplary embodiments and advantages are merely exemplaryand are not to be construed as limiting. The present teaching can bereadily applied to other types of apparatuses. Also, the description ofthe exemplary embodiments is intended to be illustrative, and not tolimit the scope of the claims, and many alternatives, modifications, andvariations will be apparent to those skilled in the art.

What is claimed is:
 1. A mobile terminal comprising: a sensor configured to sense a motion of the mobile terminal; a communication interface configured to receive, from a wearable device corresponding to the mobile terminal, information of a motion of the wearable device, the motion of the wearable device being sensed during a time period from a start time requested by the mobile terminal; and a controller configured to: determine whether the motion of the mobile terminal and the motion of the wearable device have a correlation of a level or greater; and unlock the mobile terminal, in response to the controller determining that the motion of the mobile terminal and the motion of the wearable device have the correlation of the level or greater.
 2. The mobile terminal of claim 1, wherein the sensor is further configured to sense the motion of the mobile terminal during a time period identical to the time period during which the motion of the wearable device is sensed.
 3. The mobile terminal of claim 1, wherein the wearable device is unlocked.
 4. The mobile terminal of claim 1, wherein the controller is further configured to determine whether the motion of the mobile terminal and a motion set in advance have a correlation of a level or greater, and the communication interface is further configured to receive, from the wearable device, the information of the motion of the wearable device, in response to the controller determining that the motion of the mobile terminal and the motion set in advance have the correlation of the level or greater.
 5. The mobile terminal of claim 1, further comprising a display, wherein the controller is further configured to recognize that the wearable device is within a distance range from the mobile terminal, and the display is configured to display a message notifying that the mobile terminal may be unlocked if the motion of the mobile terminal and the motion of the wearable device are the same or similar, in response to the controller recognizing that the wearable device is within the distance range.
 6. The mobile terminal of claim 1, wherein the controller is further configured to control the mobile terminal to perform an operation corresponding to an operation that the wearable device is performing, in response to the controller determining that the motion of the mobile terminal and the motion of the wearable device have the correlation of the level or greater.
 7. The mobile terminal of claim 1, wherein the communication interface is further configured to receive, from the wearable device, information of content that the wearable device is reproducing, in response to the controller determining that the motion of the mobile terminal and the motion of the wearable device have the correlation of the level or greater, and the controller is further configured to control the mobile terminal to reproduce the content based on the information of the content.
 8. The mobile terminal of claim 1, wherein the communication interface is further configured to receive, from the wearable device, information of a web page that the wearable device is displaying, in response to the controller determining that the motion of the mobile terminal and the motion of the wearable device have the correlation of the level or greater, and the mobile terminal further comprises a display configured to display the web page based on the information of the web page.
 9. The mobile terminal of claim 1, wherein the communication interface is further configured to receive, from the wearable device, information of a call the wearable device is connecting, in response to the controller determining that the motion of the mobile terminal and the motion of the wearable device have the correlation of the level or greater, and the controller is further configured to control the mobile terminal to connect the call based on the information of the call.
 10. The mobile terminal of claim 1, wherein the communication interface is further configured to receive, from the wearable device, information of an application corresponding to a message the wearable device receives, in response to the controller determining that the motion of the mobile terminal and the motion of the wearable device have the correlation of the level or greater, and the controller is further configured to control the mobile terminal to execute the application based on the information of the application.
 11. A method of operating a mobile terminal, the method comprising: sensing a motion of the mobile terminal; receiving, from a wearable device corresponding to the mobile terminal, information of a motion of the wearable device, the motion of the wearable device being sensed during a time period from a start time requested by the mobile terminal; determining whether the motion of the mobile terminal and the motion of the wearable device have a correlation of a level or greater; and unlocking the mobile terminal, in response to the determining that the motion of the mobile terminal and the motion of the wearable device have the correlation of the level or greater.
 12. The method of claim 11, wherein the sensing comprises sensing the motion of the mobile terminal during a time period identical to the time period during which the motion of the wearable device is sensed.
 13. The method of claim 11, wherein the wearable device is unlocked.
 14. The method of claim 11, further comprising determining whether the motion of the mobile terminal and a motion set in advance have a correlation of a level or greater, wherein the receiving comprises receiving, from the wearable device, the information of the motion of the wearable device, in response to the determining that the motion of the mobile terminal and the motion set in advance have the correlation of the level or greater.
 15. The method of claim 11, further comprising: recognizing that the wearable device is within a distance range from the mobile terminal; and displaying a message notifying that the mobile terminal may be unlocked if the motion of the mobile terminal and the motion of the wearable device are the same or similar, in response to the recognizing that the wearable device is within the distance range.
 16. The method of claim 11, further comprising performing an operation corresponding to an operation that the wearable device is performing, in response to the determining that the motion of the mobile terminal and the motion of the wearable device have the correlation of the level or greater.
 17. The method of claim 11, further comprising: receiving, from the wearable device, information of content that the wearable device is reproducing, in response to the determining that the motion of the mobile terminal and the motion of the wearable device have the correlation of the level or greater; and reproducing the content based on the information of the content.
 18. The method of claim 11, further comprising: receiving, from the wearable device, information of a web page that the wearable device is displaying, in response to the determining that the motion of the mobile terminal and the motion of the wearable device have the correlation of the level or greater; and displaying the web page based on the information of the web page.
 19. The method of claim 11, further comprising: receiving, from the wearable device, information of a call the wearable device is connecting, in response to the determining that the motion of the mobile terminal and the motion of the wearable device have the correlation of the level or greater; and connecting the call based on the information of the call.
 20. The method of claim 11, further comprising: receiving, from the wearable device, information of an application corresponding to a message the wearable device receives, in response to the determining that the motion of the mobile terminal and the motion of the wearable device have the correlation of the level or greater; and executing the application based on the information of the application.
 21. A mobile terminal comprising: a sensor configured to sense an input for unlocking the mobile terminal, and a motion of the mobile terminal; a communication interface configured to: request a wearable device corresponding to the mobile terminal for a motion of the wearable device, in response to the sensor sensing the input; and receive, from the wearable device, information of the motion of the wearable device, the motion of the wearable device being sensed during a time period from a start time requested by the mobile terminal; and a controller configured to: determine whether the motion of the mobile terminal and the motion of the wearable device have a correlation of a level or greater; and unlock the mobile terminal, in response to the controller determining that the motion of the mobile terminal and the motion of the wearable device have the correlation of the level or greater.
 22. The mobile terminal of claim 21, wherein the input comprises a hold and a lift of the mobile terminal.
 23. The mobile terminal of claim 21, wherein the sensor is further configured to sense the motion of the mobile terminal during a time period identical to the time period during which the motion of the wearable device is sensed.
 24. The mobile terminal of claim 21, wherein the wearable device is unlocked. 